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NOTES FROM THE EDITOR „ 

; ; ' . . ■ i__l_J_ : 

„ * p . - . '.. ~ ». . ' ' ~ • ' 

This issue has as its majdr theme the» analysis of articles ^dealing, wit-h > 
various aspects of 'instruction* Sheehan and Hambleton looked, at adapting 
instruction to "student difference^. Thomas looked at met^hocfe fo,r increasing, 
students' reading comprehension of textbooks. 'Anderson and Fowler investigated 
tftfe effects of us'ins behavioral objectives. Hermann and Hincksman compared ' , 
two „ approaches to teaching' chemistry. Krockover ahd Malcolm, investigated* the 
use, of* specific curriculum materials on the child 's l self-concept . 

The analyses vfound in the "Critiques ancL Responses" section also' deal 

with instrucfion. 'Goodstein and *Jowe studied the use of con'clrete, exemplars 

in teaching chemistry; Quorn and Ybre compared the effects of dissimilar • 

programs on reding readiness of Jcindergartners. Cavin and Lagowski studied , 

th§, ef f ectiveness^ of computer simulated laboratory experiences in, a college 

chemistry course. Preece compared the usfe of two models of the^ structure of 
* . • 

physical* science concepts on graduate students' cognitive' structure of these 

t» 

concepts. Bartov investigated whether or. not students could be taught to 

distinguish between teleological aqd causal explanations. 
• ■ • , r , *, * 

These ar-ticles present evidence that theref are many variables' to be 

* * j s * 

considered* when 'planning for teaching and when' choosing instructional methods* . 

to use in the 'science classroom. , 
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Purpose * " , 

* « p 

This study was .designed- to investigate aptitude-treatment inter- 
actions (ATI) — whether grade nine students with certain aptitudes 
learn more science when taught using one teaching method than similar 

students learn from other teaching methods, 

( ' . • 

m ' • * 

. Rationale J » , . - . 

► * 

Many recent* educational models, such as Individually Prescribed 

Instruction* (Glasefc, 1968), Project Plan (Flanagan, 1967), and a Model 

of School Learning (Carroll^, 1963)^ emphasize* adapt ing, instruot ion to 

the students' interests,* abilities, Aptitudes, and needs. Over the 

past 15 *years § there have been many studies' of aptitude-treatment 

* y _ - 

interactions (Cronbach and Snow, 1969, 1977"; Snow, 1976; Tobias, 

1976; Witkin- et al,, 1977). In general, there have been few solidly 
demonstrated ATI effects. However ,' the authors* feel that the follow- 
ing tentative principles' fart; the'design^qf instruction can be inferred 
from the literature: * • 

1. Instructional treatments which reduce, the burden of semantic pro- 

* . * 
cessing of verbal information (such as programmed instruction or*. 

a media -oriented apprqactf) should decrease the relationship* 

^between general ^ability and achievement. 

' ■ M • 

2. Instructional treatments- which pMce moife. responsibility on the 
student for organizing material should strengthen the relationship 



between achievement and such aptitude^ as^ general ability, 
achievement, motivation, study habits, attithdes, and anxiety?" 

The authors used these principles $s the basis for designing the 
instructional^ treatments and for selecting the student aptitudes 
to be measured. As a result, ^the study serves as an empirical test 
of the"* validity of these principles. 

Research Design and Procedures , 



The. research design used in this dtudy is shown in Figure 1. 
The design is a variation of the Pretest-Posttest ContrpJ? Group design 

* \ . - • ' \ 

0 — . R — T- — 0 0 0- = battery of aptitude measures and pretest 

1 1 2 p 1 f | 

» i 

0 — R — t — 0 0 o = criterion-referenced posttest * - 

4 1 2 2 w ^ 

O — R — ^3"'"^2 * R = random assignment to -treatments 
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Figure % l: Schematic representation of the research design 



0 r x 0 , » four different -instruct ional ^tre|tments 

1 .4 2 



(Campbell and Stanley, 196^) in that there are multiple, treatment groups 
but no confrol ' group. . ^ * 

The subjects for the study were, 285 students-enrolled in a ninth- 
grade science program. The report does riot indicate the general abilltyT 
level of the sfudents, their science backgrounds, ,their socioeconomic 
status, or whether 'they even attended the same^chool. The students 
were randomly assigned to one-,o£ the four treatment groups. .There is 
'no indication that the random assignment was stratified. 

Each student wrote a total of 12 aptitude iestsjprior to random 

assignment to the various instructional 'treatment groups." The .aptitude 

testsjused were: - . . 4 < 

- % 
J* • • ■ , . ' " . 

1. Module Pretest (40 four-alternative multiple-choice questions 
. — no 'reliability ox validity data). / 



* • 

• *2. Lorge-Thorndike Intelligence Test. 
*3.* Science Research Associates (SKA) Achievement Series. 
*4. Survey of Study ^Habits and Attitudes; 
*5, Junior Index of Motivation (JIM Scale). 
*6. # Tegt Anxiety Scale for Children. , 1 - 

*7. Children's Manifest Anxiety' Sicale. * t 
*8.. Intellectual Achievement Responsibility Scale, 
• *9. School Anxiety S^ale. 9 - . 

' 10. Mathematics Test (np reliability or validity, data) (Freagji, 

v Ekstrom and Price, 1963). <■ 

> "v ^ 

* 11. - Letter- S^ts o Test (no reliability or validity data) (French* • 
et al., 1963). ■ ' . ' " 

*12, Student Attitude Quest iojmaixe (semantic differentia]) format 
— no reliability or validity data). \. J 

' j . "•. . • :i * 

Most of these aptitude test instruments (those marked with an *) are 
standardized or quasi-standardized and reliability aijd/or validity 
data are available in the literature. The module pretest and the 
student attitude questionnaire were devised by the researchers and no * 
validity or . reliability data are provided. ' '* 

♦ The instructional treatments were described in the study as: 

Teacher-Directed Treatment. Students assigned, ^o this .instruc- . 

tional treatment met in a teacher -led class and were presented a series 

v 

. of lectures by ninth-grade science teachers. 

Media Treatrt&nt. Students in this treatment - worked &6ne or in 
pairs on four' worksheets that were used in conjunction with ane video 
tape* and seven audio tapes. * # 

Reading Treatment. This treatment consisted of a reading handout 
• > * 

composed of an .assignment section and a section of appropriate read- 
f ings. Each student, who t was assigned to "this instructional treatment 
worked alone on his booklet of readings. " , 4 

Programmed Instruction 'Treatment. 'Students- assigned to this 
instructional treatment worked alone on one^et of five- booklets con- 
sisting of 185 frames of 'progra»med, # instruction- material. 



There%is.no 'itididation of what, time of year the^tudy v*as conducted, / 

its duration, or whether the students in the various instructional 

• r < • / - ' i 

treatment groups./ received the same, number p£ hqurs of instruction. 

*. * * 

The criterion measure for the studyH/as-a Module Posttest. lit con- 

j * , 

s-isted oj&40 four-alternative multiple-choice* questions. No validity 1 

r ' 

or reliability data are provided. The report does not indicate if this 
pjfrg&test was identical toj the pretest given prior to instruction (both 
.have 40 items based on the module objectives)'. The Module Posttest was 
administered immediately dfter instruction and again a month later ^ ' 
^Delaryed Module 'Posttest) . ' ; 

- » % & , * • 

The t data were analyzed using a ^r^gjression analysis. • The crit<e*rion ^ ~ 

variable (score on immediate or dela)^^)6sttest)' was regressed on the 

various aptitude variables, for each treatment group. 'Unspecified * m 

statistical procedures were then used to test) the parallelism of slopes * 

of the different groups for each aptitude measure. Due 'to technical 

problems with the media* treatment., tlje analyses were repeat£d*excluding 

this group^ • * . -ft',.. 

In c&ses .where the parallelism of slopes hypothesis was rejected, 
a Johnson-Neyman analysis (Potthoff, 1964> was* performed pn each pair- 

of treatment groups within 'each interaction to*_detesmicie;*the utility ' 

'* ")* *' ' ' ° > 
of the interaction. 4 * 



F inding s * ~ 

* ^ , 

* *' • r# • 

\ In three cases the parallelism of slopes hypothesis was rejected 

1 • ** 

at the 0.05 level. The Johnson-Neyman analysis indicated that in only 

' . * -* i 

one of these cases was the interaction disordinal. This occurred 

%> ^. * t * * 

when the Test Anxiety Scale for Children. wag the^Miitude, the Delayed 



ERIC 



Module Posttest was the' criterion, arid <'the media treatment group was 

* * ' * * 

excluded* Only, .the reading' and programmed instruction treatments had 

significantly different slopes at the 0.05 level. The Delayed Module 

Posttest scores rose slightly with increased test anxiety scores foi; 
* * * 



the reading treatment* (slope b.04) and fell fairly rapidly for the 
programmed instruction treatme,nt*"Xslope £r - 0.6'8)» * The Johhson-Neyman 
region of nohsignificance for these* twcT~groups lay between scores of* 
5.8 and 23.3 on the Test Anxiety Scale~for Children* This indicates 
that students with "scores below 6 should be •assigned to the programmed 
instruction , treatment and those with scores above 23 should receive 
t"hexreading- treatment . . ' ' • . ** 4 



Interpretations S ^ • . \ J • * 

„ * The authors' feel that their* results should be interpreted with 
considerable- caution because of the possibility that the "tfhree inter- 
actions <Lhat were detected- were simply chance results, ^hey feel tlhat 
the lack of definitive results was due to faulty design of the study — 
specifically with the construction and execution. of the instructional 
tr-eatfments.. XX appeared that the treatments were nfct separated as 
Completely as would have. been desirable for experimental purposes. 

* . " "ABSTRACTOR'S ANALYSIS * % W 

* * ~* 

The study of aptitude treatment interactions (ATI's) is a rela- 
tively new field of research.* It began about 20 *years ago in response 
to Cronbach's (1957) call for 'cooperative research 4 ,between experimental 
and Correlational psychologists. "> c ■ » v * f f 

.> # - . ' " t 

* Thi*s new area of investigation has generated a great deal df 

interest because the differential instruction of individuals based on* 

their- needsv interests, aptitudes apd -abilities is the cornerst6n£ of 

individualized* instruction. The nuiherous 'studies $>f ATI's have been 1 

* # * *" • 

capably reviewed on several occasions (Crohbach fl and Snow, r9$f9; 

* * * " * a&' ' V * 

Berliner; and' Cohen,. 1973; Tobias, 1976; * CTffnbach and Snow, 1977), 

Despite thfc many studies in this area, -progress ha^been slow. In' 

general-, ttfe research reviews indicate that*thefe are few;* if any, * 

replicated ATf-s 'that^permitrprescriptive instruction. \ . 



In view of this discouraging conclusion ^reactied^by 'the various 
reviewers of the research on ATI's,- dt is^not clear how this study 



fits into the matrix of previous- research inj this field or on what 
basis the authors inferred the -tentative guidelines for the design 
pf instruction tljat form £he basis for the study. • 

In their reviews-Qf the research in.ATI's, all. of' the reviewefs 
have commented on a dommon weakness of ATI studies that af f ectS^fHeir 



validity: that the aptitude variables and the corresponding instruc- 
tional- treatments have not been very carefully thought -out\\«Of ten <ithe 
instructional treatments have differed only in minor details so that 
these, treatments have not tapped different aptitude^. In view of thi^ 
continuing criticism it is -unfortunate that Sheehan and Hambleton 

provide such a, brief and cursory description of the instructional 
« 

tjreati&ents used in the study.* A more ex-tended description would have 
allowed a reader to assess the validity of the authors' statement that 
the paucity of results was due 'in large part to pro-blems in the 

construction of the instructional treatments. 

. * 1 ° . *&■ 

The validity of the study^is further weakened by the relatively 
short duration of the instructional treatments. The aOthors do not 
nrefitioa exactly how long the treatments lasted but treatment brevity 
can be inferred firom their statement that the treatments extended over 
a small segment ((module) of a ninth-grade science coursed Practicing 
teachers are well aware of th^ fact that an abrupt change in teaching 
methodology, % suth ~as from a lecture-lab method to programmed instruc- # 
tion or a Set of - readings and workshefcts^ can serve as a string moti- 
vator but can also generate a great deal of confusion over a several 
week period v as 'the students and teachers gradually adapt, to their new 
role'S/and responsibilities. As a result, any potential' differences, 
in .the ef f ectiveness *of the. various treatments on different students 
may well have been swamped by these extraneous factors.. 



v . 



The* research'design chosen for the study was^an unusually rigorous 
one. * Undoubtedly the researchers encountered stiff opposition to the' 
random assignment of. students to trfeatment^ and they are to be commended 



for insisting orf its use~-it certainly strengthens the validity of . . * 

\ - . 

the study. 

• / % ' ' • * 

, In general, the research report is well written. The candor with 
which they discuss possible-reasons for their failure to* detect more 
ATI's -is refreshing. ^However, they fail to mjention°xn their discussion 
any consideration of the power of the statistical tests they 1 employed, 
(Statistical pqwer is rhe probability of detecting significant rela- 
tionship when'the relationship does, in fact, exist.) A number of 
statisticians, Cohen (1962) , Brewer il^ll) , and Schmillain (1976), have * 
commented- on the very low statistical power* inherent in most educational 
research*. Educational researchers .planning studies would be well 
advised to kfeep abreast* of the literature on hypothesis testing and 
power 'Analysis. Cohen's hook, Statistical Power Analysis for the 
^ Behavioural Sciences (Rev. ed., 1977), clearly outlines the concepts 
and procedures involved and should be on every researcher's bookshelfc. 
>Coheri's (1979) proposa^for new conventions for designing and^ reporting 
research results deserves widespread attention from the research\ 
community. „ f 

• The research report would have been more useful if it had more 
complete -description of how the tentative guidelines for the design 
of *tjie treatments were related to previous studies. A description * _ 
of tTie previous background arid socioeconomic status of the .subjects 
would have allowed the reader to g^uge the -generalizability of the 
results.,. A description of how the battery of apititude tests was • 
; administered would have allowed t the reader to sffesess the possible 
effects of fatigue and test weariness on the altitude test scores. 
£s .previously mentioned',* a more adequate description of the 'instruc- 
tional treatments axid their duration would h^e allowed the reader 



to asisess whether the treatments engaged different aptitudes and" 
whether novelty effects qpuld have swamped the ATI. 

The^ field of ATI's has been, and still is* an important and popu- 

<fer one. """However, as the- previously mentioned research reviews have 

* 

pointed out, the problems are many, ^nd progress has been agonizingly 
slow. Future researchers in this area mu6t be*., careful to design 

*- ' • ' • r 9. ■ ■ ■ ■ 



Tiheir instructional treatments so that__they dor"erigage~dif f erent 

a^titJodesr^o^n^ufe^that the treatments extend* over sufficient 

time so that the ATI's are not swamped by extraneous^f actors, and, 

to design tfh^ir studies with sufficient statistical power so that 
* ** * • 

the hypothesized effects are likely to be detected. 
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Thomas, J, L. fl The Influence of Pictorial Illustrations with Written Textr 
and Previous Achievement ,on the Reading* Comprehension of Fourth Grade 
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^panded abstract and analysis prepared especially for I.S.E.. by William G. 
Holliday and William Winn, The University of Calgary. 

• * 

i V 1 

* * « * «* • 1 ' 

Purpose . • 

Dr. Thomas asked three research questions.' , First, do the addition pf 
line drawings or photographs adjunct to a textual description of unfamiliar 
science information 'facilitate* in fourth grkde students, comprehension of 
the verbally expressed information? Second, dc^the composite SRA reading 
and science achievement scores of these learnets predict "literal 11 and 
"inferential 11 comprehension of unfamiliar science information? Third, what 
is the predictive relationship between reading" comprehension and general 
science achievement, as % measured by SRA assessment instruments? ^ 

* i 4 

Rationale **• m 

Publishers 1 of elementary school science materials use many different 
types 'of line drawings and photographs to illustrate ideas described in 
--t4ie-prQ&e_portion of their & textbooks. Yet, few investigators have eval- 

• uated the learning effectiveness of these pictures £n terms 'of previous 
achievement and colored-uncolored and incliision^exclusion pictorial varia- 
bles^. Previous research suggests that pictorial illustrations either have 
no effect on comprehension (Samuels,^ 197*0) or have unclear effects on com- 
prehension (Holliday, 1973, 1975)., Indeec}, Travers and Alvarado (1970) ■ 
indicate that publishers make editorial* decisions about including textbook 
pictures based on unsystematic intuitive reasons rather than on empirical 
grounds, hence, the need to investigate 4 dn a general fashion the learning 
effects of* pictures adjunct to prose passages. 



Research Design and Procedure ' 

A sample of 108 fourth-grade students from three elementary schools 

was randomly assigned to a multiple colored photograph-text, single 

colored-line drawing-text or a text-only 'treatment . ;-The first treatment 

consisted of pictorill and textual displays taken directly from a recently 

published book. The second treatment was a simplified (apparently 
» % 

uncolored) drawing substituted for the publisher 1 s photograph and set in 
a sirtgle coiored background. The third treatment consisted of the pub- 
lisher's prose description without illustrative adjur\ct pictul^es. These 
experimental materials j^ ere photographed arid projected on a screen using 
a twp-by-two slide projector. Subsequently, students were administered 
a comprehension posttest. This procedure was conducted on two occasions, 
(apparently) attending to two science topics at^^ch sitting. In addi- 
tion, subjects were c adminxstered* the SRA reading arid science achievement 

tests for use in evaluating the second and third research questions. 

» * 

* * * 

The four science t;opics chosen from a' group of-~20 were identified by 
the subjects as those least familiar to them. In addition, the experi- 
menter used Fry's readability* graph to assess the appropriateness of the 
chosen prose material and ujsed Smith and Barrett's (1974) taxonomy of 
reaching comprehension in the development of the posttest to insure that 
items measured either literal (i.e., recognition) or inferential* (e^g., ^ 
implicit main ideas) learning.- ^ 



Findings 

§ - .. 

. 'No significant 4 differences were found among the^group mean scores 
nor among treatment-by-SRA test data.* However, significant (jiffe r ences 
in posttest scores were detected ill the predicted direction among the 
high; medium and low performers (i.e., high > medium > low performers) 'on 
the composite score variable (SRA reading cbmprehension. £nd science 
achievement). Finally, analysis of the SRA composite score yielded a' 
positive correlational coefficient . (05), as .predicted. ' * 



Interpretatlons- 

^7 It was conditionally concluded that the type of adjunct picture 
(drawing vs. photograph) and its inclusion or exclusion apparently had 
no influence on student comprehension of science iiifapnatiorr; TV this 
regard, "Publishers could greatj^ra^trc^some of the enormous expense of 
reproducinjg_^jad^tncluding color photographs 11 in their science textbooks. 
Furthermore, these books apparently were written for the average student 
when, indeed,- such averaging failed to meet the learning <need£ of 
students of high or low abilities. 



ABSTRACTOR'S ANALYSIS 

This sj£udy did not contribute to our understanding about how visual 
media facilitates in children comprehension of science information pre- 
sented adjunct to a prose passage. Furthermore, the correlational find- 
ings dealing with* science comprehension and the SRA instruments were not 
scientifically significant. Indeed, Dr. Thomas was ) cognizant t of weaknesses 
contained in his study, as sugg'ested by his remarks to us and by those made 
to his audiences (Thomas, ^ote 1) at the- 1977 Association for Educational 
and Communications and Technology. (AECT) annual "meeting, ..Based on his 
comments and other apparent abilities, we believe he is capable of njaking 
a substantial contribution to the field of educational' communication. , - 
Nevertheless, we will describe some of the more serious problems associated 
with the present study and cite recent methodological advances and empiri- 
cal findings outlineyd by other researchers exploring the learning effects 
of adjunct visuals. ... 

• ■ 

The most serious problem constitutes Dr; Thomas' pointed suggestion 
that "pictures do Q not influence comprehension. rt Careful inspection of 
other research studies does- not substantiate this "no-effect" suggestion 
and thk experimental results used to explore this general hypothesis do^ 
ftot provide the evidence needed to give it reasonable support for three 
reasons. First, a single experiment providing "no differences" or neg*a- 

• _ . ' ■ — '- 

dve evidence does not ^constitute grounds for suggesting that two or more 
instructional treatment conditions have a similar effect on. learners. In 
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fact, such findings are of little scientific interest 1 and are often con- 
sidered meapingless when an experimenter theoretically deduces from the 
literature an expectation of positive results, in this sense, the 
literature review presented. -in- the ^rticle is incomplete and somewhat 
misleading. For example', Holliday's (1975) and Holliday and Harvey's 
(1976) 'work clearly supports the general hypothesis that adjtmct'pictrures 
can facilitate comprehension iri secondary school science students. Yet,, 
reading Dr. Thomas f literature, review, one is left with the impression 
that this hypothesis lacks empirical support. > . v 

Second, Dr. Thotflas chose not to use a traditional control group, 

thereby leaving open to question the possibility that subjects did not 

comprehend on the average treatment information. Data generated from 

a control group 'would have provided 'a baseline of performance, from which * 

experimental data could have been interpreted. - Indeed, interpretation 

• * 
of any kind is most difficult (if not impossible) j under such "no-control" 

conditions when W> significant differences ( are reported among treatment 
groups. The checfebist mechanism used in this study tp select treatment 
information! cannot be considered an adequate control of previous know- 
ledge because of the unreliability of such assessment methods. 1 

Third, the experimental variables are vaguely defined. Specifically, ' 
the following variables are not described* in the article: 1) the 
"science" topics presented to the children, 2) an operational definition 
of the prose passages and the "comprehension" posttesjt, 3) the informal 
tiopal nature oi the pictures and the degree of prose-picture information 
overlap, and 4) a clear description of the procedures used to treat and 
.assess the subjects. (Incidentally, some of thi^ information was presented 
in Dr. Thomas 1 AECT address.) On the other hand; Dr. Thpmas 1 well-written ■ 
article suggests (but does not confirm) that a conscientious effort was 
macje to provide ffcurth-grade children with "appropriate" learning mater- " 
ials and "reasonable" posttest Sterns.' * 

Without question, pictures" can facilitate the learning of prose 
material* contrary to earlier cl'aims matfe by such researchers' 'as„ Vernon 
(1953) and Samuels^ (1970). Most of t^he recent wort£ in this area (see 
Holliday^ 1973; Levin and'Lesgpld, 1978) has evaluated ' elementary schodl 
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, children ^listening to fictional narratjLvfes read to them while viewing 
a line drawing illustrating the main ideas of tfiV story Those studies 
talcen together support thi£ "pictures-can-help 11 * hypothesis and permit^ 
some* generalization across:^ 1) methods of presentation (e.g. , -verbal 
information presented in isolated sentences and in prose forms and 
visual information displayed in booklets projected on large classroom 
screens, and presented to children as* lairiinated plastic cutouts), 2) 
methods oj£ testing (i.e., cued recall using verbatijn and paraphrased 
questions) , 3) learner aptitudes (i 5 e., sex, *age,. social class r intellect 
tual .ability) , 4)»passage characteristics (i.e., length, complexity, topic 
of narratih/e)*, and 5) retention time (i.e., immediate and delayed recail) / 

Pictorial research in science e^du^ation during the past decade has, 
mainly focused attention on, junior and senior # high schopl students learn- 
ing "textbook" information using Adjunct 'line drawings and photographs 
(Dwyer, 1972, 1978; Holliday, 1975; Hofliday and ^Harvey^ 1975) and», 
specialized learning materials ^including flow diagrams (Holliday, 1976; 
Winn, in press E). On the whole, the .empirical Evidence and theoretical 
explanations suggest that visual media^can facilitate science learning. 
However, whether pictures have »a similar effect gn children learning 
science processes and concepts is currently a matter of speculation. 

0 

Consequently/ science educators interested in this research area* will be 
pleaseH to learn that "recently reported methodological procedures ($ee 
Levin, Bender, and £ressley, 1979) can be used with 'confidence to* examine 
a multitude of adjunct pictjure hypotheses dealihg tiith elementary school 
science. In addition, theoretical frameworks used to deduce research 
questions about the learning effects of pictures on -young science students 
are derivable frpm commonly cited Piag6tian sources and a wide variety o*f 
recent non-Piagetian works«(e s g., Ausubel, Novak and Hanesian, ~1978; Brown 

and Smiley, 1978; Gagne and White, 1978; . Presslev, 1977.; Schallert, 1978; * 

* * * *■ * 

"Winn, in press, b). ** 
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Purpose s • . 1 

• . h ' > 

The. purpose o^f the study was to expand research information regaling 

the effect^'of selected entering behaviors and different cognitive ^levels 

of behavioral objectives on ^earning and retention performance in a unit 

6n populatrion genetics. The selected entering behaviors were prior know^* 

ledg'e and critical thinking. The different cognitive levels of behavioral 

objectives were (1) low, (2)', high, (3) both low and high," and (4) ncme. 

* 

The learning and retention performance was measured by criterion tests com- 
pleted ^y 121^ preservipe elementary education majors. The unit of popula- v 

tion gen'etics was a 97-frame e'xcerpt from Population Gentries: A Self- 

' — ' 

Instructional Program by R. Anderson, V. E. Drantz, G. W.- Faust, and J.i T. ' 

Guthrie. -> ' . 



'Rationale f • * - * 

Bloom (1956) edited the Taxonomy of Educational Objectives, Handbook 
I: Cognitive Domain . Many* studies have usett the clear definitions for C 
classifyirig questions or behavioral objectives which this Taxonomy has 
provided^. Some recent studies have demonstrated that learners function 
differently when they are challenged by different levels of the -cognitive 
domain (Madaus, Woods and Nut tall, 1973; Anderson, DeMelo, Szabo and Toth, 
19.74). Science educators generally recommend an emphasis on the higher 
levels of the cognitive domain. Another major recommendation for the • 
improvement o-f instruction arises from Ausu£el f s study '(1963) of advance - 
organizers. This? st^udy^used behavioral" objectives o"f different levels of 
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the cognitive domain as advance organizers for a self-instructional pro- 

* * * * 

gram. . Previous »esearch studies encourage the anticipation that advance - 

organisers will be post effective when they ar.e in the higher levels of ^ 

; the cognitive domain, ' . , 



Research Design and Procedure , * * 

• • This study used the pretest-posttest control gipoup/design . The pre- 
tesi determined prior knowledge of basfic genetic conce£t>s (PKT) This 
pretest was' given one week prioV to the treatment, 'At this same tifne^.the 
1'21 subjects completed the Cornell Critical Think||^Test (G£TT) . .Two 
posttests were given: (1)' postcriterion tesx (PT^ immediately after t the 
treatment, and (2) postcriterion retention test *(PT 2 ) eighr weeks after 
the treatment. <fc * . * . 



Within the treatment was the study* o£ the 97-frame excerpt from- 
Population Genetics: A Self-Instructional Program . All subjects used^the 
same ^7-frame excerpt *and proceeded independently at their own pace for 
three da}fs. The first T^e* of the learning packets was of four> different 
types and therefore generated'fouir different treatments: Treatment 1 was 
a list £f low cognitive level behavioral objectives - "Treatment 2 was a 
lisjt of high cognitive level behayipral objectives; Treatment 3 was a list 
of bpth low and high cognitive level" behavioral objectives; Treatment '4 
was a plapebo rather than objectives. , Although this last list was made 
to appeajuas the lists of 'objectives, it consisted of a list of statements 
of genetic curiosities. Because the last treatment was not a 'treatment 
with behavioral objectives, the subjects receiving this treatment Served 
as the control group. . -\ ^ 

The 121 subjects were preservxce elementary education majors at a 
~ # * 

major university in Pennsylvania. They were, divided into two equal groups 

on the basis of the prior knowledge test <PKT) by using a median split at 
the score of 19. Equal numbers of subjects with high or, low* prior know- 
ledge of selected genetic concepts wer6 randomly assigned to each of the 
four treatments. Similarly the Cornell Crititfl Thinking Test (CCTT^ was 
used to divide the same subjects into two groups by us^ng^a median split 
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at the score of 30. Equal ntlmbers with high or low critical thinking \ 
scores were randomly assigned .to each treatm^gf. ' Combinations of subjects 

_4>y scores on PKT and CCTT generated these four groups: ^(1) low scores on 
both tlsts, (2) low on PKT but high on CCfT,' (3). high on PKT but low CCTt, * 
and (4) high scores on both tests. Because each, of these f€uir groups were 
"dividedlby four' different treatments, 16, distinct subgroups were finally 

identified. The number of subjects in each of these fin&L" subgroups Tanged 
from 3 to- 11 : . . ■ , 
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' The data on t°he two postcriterion tests (one showing immediate learn- 

ing performance and the other cfeho fist rating retentien performance after 

eight weeks) were analyzed by using a two-way analysi-sf-of variance to • , 

compare the four treatment^ and two levels of entering behaviors/ Because 

the number of subjects in -the subgroups we*e unequal, the program ANQVUM 

* *> . * 

was selected from The Pennsylvania State Uijive#sity Computer Center library. 

Comparisons of the specific subgroups were made as well as the cohsidera- " 

.tions-of larger groupings within 4:he study. r , 

The postcriterion tes£ consisted of 32 items considering the learning 
task o # n population genetics. The postcriterion test (f^T ) was given eight 
weeks letter as (PT 9 ) with randomly reordered test itegip. These post- 
criterion tests had three subscales, each designed, to measure a specific 
level of cognitive ability congruent with the behavioral objectivls .and 0 
the learning packets. The three subscales were for measuring knowledge, 4 y 
comprehension, aftd application which are the first three^ levels of Bloom's 
taxonomy of the cognitive domain. A selected panel of .experts had 95 per- 
cent agreement level '^.n establishing the content validity of each assessment 
tool used in the study. . ' * - - 

Findings ' , , • _ , ' 

^ The su£j\»cts in the four treatmet^fe^^d tiot differ significantly an 

posttest scores £or either P^ or PT^. On PTj." differences were found m ' 

between subjects with high and subjects with low prior knowledge "levels 

•t - * . 

when they experienced Treatment 3 (which consisted of both low and high 

cognitive levels of behavioral objectives). In this' situation Bhe gi^ap 
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with high prior knowledge had 'significantly higher scores on the knowledge 
level questions. On PT 2 differences were* found between subjects with high 
and: subjects with low prior knowledge levels when they' experienced Treat- 
ment 2 '(which' consisted of high cognitive levels of behavioral objectives)", 
In this situation the group with high prior knowledge had significantly 
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higher scores on both the knowledge and the comprehension questions. No 
significant differences were' found on the basis qf identifying -the sub- 
jects as high or low critical thinkers. 



Interpretat ions * * > / , 

The invesifcigator' made the following conclusions:, "(1) Behavioral 
objectives meaningfully presented to some learners^ with a new cognitive 
tksk £an enhance learning at the knowledge and comprehension levels. X%) 
Behavioral obiectdves based on cognitive levels of learning according to 
.Bloom (1956) 'and consistent with programmed materials providing low and 
high cognitive level experiences enhanced learning for stedents identified 
as having high prior kno^ledg£. * (3) T£e, identification of specific enter- 
ing behaviors seems to be a significant variable for a, learner's perfor- 
mance in content^specific learning tasks. (4) .'Systematically, written r 
programmed instruction seems to enharfce learning for some students. (5)' 
No interaction was noted between critical thinking -ability and treatments. 
This deads one to the notidn that the domainsof critical thinking ability 
and the levels of cognitive behavioral objectives presented in this study 
are in fact independent of each o'ther. 1 ' The 'investigator observed that 
this sNzudy encourages College science teachers to preassess students 1 know 
ledge. x <- , .* i • * r r 



•ABSTRACTOR'S ANALYSIS 



Previous research studies* suggested this study by which- behavioral 

- ' * a ' * * 1 - - *' ' " 

obiectdves of different levels of the cognitive domain were .used as. 

advance organizers.* Researchers "generally will. v anticipaj:e that advanc| *♦ 

• H * } " r> * .* '" < \ ' 
organizers af* the higher , levels will seifve best as factors which improve 

'» ' * ■* i ii ' 

learning. - Research, bn.it'esting indicated-thSt students' will* be best' 



prepared. for any examination by anticipating essay £uestion3 which will 
require higher Tevels of the cognitive domain. Ausubel and others have 
* demonstrated that advance organizers 60 impro^ learning. Thi^ study 
attempted to provide evidence in support of generally accepted concepts. 

The design and -procedure of this study seem correct, with the'follow- 
ing exceptions: (1) All subjects proceeded independently at their own 
pace for three days to complete the' learning from-tjje 97 frames. (2) 
Although the total number of subjects was 121, the subgroups consisted of 
an average of only 7, 56'students with arrange from, 3 to, 11. These two 
exceptions tend to eliminate potential significant differences and the 
possibility; x 6f reproducible generalizations. 

The first problem with the procedure was to allow the" students the 
^freedom to'study the materials for three days. Apparently no "data were 
gathered on the amount ofotime dedicated to this project, by each* student . 
Therefore, each student had the^opportunity to work toward complete 
mastery of the 97 frames in the learning M packets. Students with m weak 
background in the concepts or with poor skills of critical tftinking could 
easily, arriye at mastery of the^ a3signed material by spending a relatively 
large amount of time in study* Some studies on individualized programmed 
materials have demonstrated that students will achieve mastery by using 
widely varying amounts of time, e.g., Some students will use four or five. 
times 8 as many hours as other Students, ^ro^ably^all off^He .121 subjects 
were capable of achieving mastejry of 'the mat^rikla under *the given circum- 
stances. The most important variable have been the motivation of th^ 
students toward this, task. Some individuals strongly dislike self- 
ins truc£ion$J. programs while others greatly enjpy them.. The investigator 
concluded -that 1 systematically written programmed instruction seems to 
enhance learning jf or some students. Yes, this study doe£ show that tl^e 
subjects leart^e^ ;by use of such materials. The study does not shdw^anjr 
comparison of tljis type of learning with other methods and therefore pro- 
vides little or no support for selecting systematically written programmed 
instruction as. a method of c instruction. y 



% ' Tfie investigators c6ncluded**t,hat A behavioral objectives meaningfully 
.presented to some ^learners wifch a new cognitive task can Enhance learri'ing^^ 



at the knowledge and " comprehension levels. The data from this study 
limit the "some learners" to only two situations: (1) On the group 
of 14 subjects with higher scores on the prior knowledge test (PKT) had 
significantly higher scores than thelT ^subjects with lower scores on the 
PKT when these two small subgroups experienced Treatment 3. The higher 
scores on PT n were limited only to the knowledge level \questions. These 
results were not replicated in PT 2 « (2) On PT 2 the* group "of 17 subjects 
with higher spores on the PKT had significantly higher scores than the 13 
subjects with lower scor^' on the PKT ^hen these two small subgroups exper 
ienced Treatment 2. These, results were limited to scores on the knowledge 
and on the comprehension questions and tfere not found on PT^ : Obviously 
the significant differences in this study are relatively rare events, 
based on small samples, and not replicating "between the two posttests. 
The lack of consistent, trends in the* 4 ata seems to indicate that the sig- 
nificant differences may be generated by undetermined differences within 
the small samples. ° The abstractor has little confidence that the same two 
situations qnd only these' .two .will produce significant differences if the 

study is repeated with another 121 students, 

i 

Bloom, (1976) generalizes that half of the variation in achievement 
by students can be attributed' to prior knowledge / *This study does support 
the impact of p^pior knowledge by showing that some groups have improved- 
scores on a posttest when^they have higher scores N on the prior ^knowledge 
test. Nevertheless, the significant differences are relatively rare and 

• 0 4 

probably were eliminated in most comparisons by the uncontrolled factor 
of time spent on the learning. The investigator is correct in concluding 
'that the identification of specific entering behaviors seems to be a sig- 
nificant variable for a learner f s performance. 

+ % \ * 

* v * i 

* The investigators conclusion that the domains of critical thinking 

ability^and the levels of cognitive behavioral objectives presented in 
this study are independent of each other seems to be based on very weak \ 
evidence. As noted above^ there are only two situations among the 16 \ 
simitar comparisons which produced significant differences. The small 
samples in thesetwo comparisons supported the well established recogni- 
tion of the major impact of prior knowledge on future achievements in 
learning. The abstractor believes that <there^ is a weakness in this study 
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because it does iiot provide more evidence in support of impact from prior 

knowledge. The absence of significant differences on the basis of the 

scores from the ^Cornell Critical Thinking Test may be explained in terms 

of variations of_ time spent in studying the packets, variations in moti- 

vation toward self-instructional packets, and the size of the 4 samples. 

The abstractor does not find the absence of significant differences to be 

sufficient basis, fo reestablishing the independence^ critical thinking 

ability from tfie~ higher levelrs^Qf the cognitive domain. Definitions from 

.Bloom's Taxonomyi (1956) seem clearly to require critical thinking ability 

in order to achieve the higher levels of 7 cognitive thinking, The only 

* .0 

conclusion which the abstractor could confidently support is the recogni- 
tion that prior knowledge is the most significant variable in predicting 

achievement on sglf-instructional programs. 

■ _ *« 

* *« 

The investigators recognized that thi» study provides the implication t 
for college science teachers to preassess students 1 prior knowledge. 
Certainly teachers will be most effective in their selection of curriculum 
when they clearly know the level of knowledge of Students when they begin 
each unit of instruction. The investigators have been helpful to science 
educators by encouraging the use of preassessment to meet the unique needs 
of learners, In-this study, preassessment was used to divide the subjects 
into groups of high and of low prior .knowledge and into groups of high and 
of low critical thinking skills. In research studies7 ^retesTin^^s ' 

c 

usually given tofdetermine the increments in achievement for each* subject. 
The abstractor hypothesizes that if increments had been "measured in this 
study*- the subjects with low prior knowledge probably would have achieved 
significantly greater' increments. • This hypothesis is based on th*e finding 
of -few significant differences among groups in the posttests. The abstrac- 
tor's" suggestion for' another research .study would contribute to the many 
studies already competed on self-instructional packets as a method of 
learning. - 4 . 
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Purpose „ 

, - - " ( - * • 

The purposes of the investigators in this study -are twofold. First, the 
efficacy of inductive and deductive teaching methods are compared in 
teaching a unit of chemistry. Second, trait- treatment interactions con- 
cerning "subsets of learners and increased effectiveness of the inductive 
method are investigated. , • 



Rati6nale * % . , 

Proponeats of inductive learning claim that student involvefliRt in problem- 
solving activities aids retention and further discovery learning. However, 
a second c^laim often leveled by critics is that inductive problem solving s 
activities require more time for students to \each. identical learning goals 
than* (Joes a deductive approach. •* 

* . *m 

Discovery learaing_jexpea?±metits , according to the investigators, are. gen- 
erally concerned with sequence of instruction. In this study* inductive 



and deductive strategies are compared which are distinct in ttitf'Sequence 
of instruction but ^re identical in time allotment. /An induc/ivfe learning 
strategy is characterized by examples of a 'rule followed by a rule,, 
whereas a rule followed by examples of the rule identifies a deductive 
method -in this investigation. 



Evidence ift the literature of education and psychology indicates that 
differences in subject performance under inductive' and deductive treat- 
ments may be expected with resperct. to IQ, trait anxiety, '^ind sex. 
•Specifically, high IQ subjects will perform inductive problem-solving 
activities better than average IQ students. High IQ children will learn 
equally well by an inductive or deduttive strategy Ayerage IQ students 
will retain more information after inductive learning than after- deductive 
learning. Further, .highly anxious subjects- will .leatn better deductively v 
than inductively <Sakmyser^ 1974) .Finally, mile "students: will outperform 
their female counterparts in the inductive learning of a chemistry task 
(Ormerod, 1975). 



Research 'Design and Procedure * 

The independent variables in this factorial research design were instruc- 
tion, trait anxiety, IQ ar^d gender, whereas the dependent .variables were - 
the immediate and delayed posttests. The data were analyzed by analysis 
■* of variance, y x . - x , 

Participants in the study were ninth grade advanced 'level science students 

from nine higK schools in the Sydney, Australia, metropolitan area. There 

were 455 Subjects involved, but 156 case^ were not included in the data 

analysis because of absence, lack of IQ data, and clerical errors.^ 

•Exclusion /of these "subjects left 299 cases" (13^ males and 165 females) \ 

" • ' \ whVwere randomly assigned to the inductive or deductive learning "program m : 

'on a within-class basis. The authors noted that subject wastage was 
* 

* * random. ; , 4 

Deductive and inductive instruction was focused- on stoichiometry , a unit 
in chemistry not yet encountered by the subjects, {.earning materials 
included linear programmed instruction booklets and separate respons'e ■ 
■ sheets for .each type of instruction. A fixed rate of instructional 
progress *Was -assuted by use of audiotapes. The lone distinction between 
the deductive ^nd inductive booklets was in* the' relative- placement of 
the rules to be taught, lach booklet contained 60 frames; the rule was 
placed in the eighth' and tenth frames ^ of a 10-fraijie set ifl the inductive 

lERIC ' • . 33 ; . 



format, whereas the rule yas foilnd in the first and third frames of a 
10-vframe set in the deductive format. 9 'A table of chendrcal symbols and 
valancies (authors term) and an answer 'she^t were included in each 
prograiri. All direction? were administered via audiotape/ and the time 
allotment (30 to 90* seconds per frame) was also controlled in this 
manner. The total learning period lasted approximately one hour, A 
posttest .was administered immediately following instruction and a 
parallel f orm W the postte'st was given two weeks later, A modified 
form of Sarason T s Test £nxiety Scale for children was administered 
immediately, following the second posttest Th6 investigators did not 
specifically mention the source of IQ data;* it is a logical guess that 
such information was obtained from school records/ 



Findings , 

A summary of the authors 1 findin^^is given below: 

1, The deductive instructional group scored significantly' better 
(p <.05) on the immediate posttest than did the inductive ***** 
instructional group, but no significant difference, between 
.treatment groups was revealed^ on the delayed posttjsst. 

* ♦ * 
♦ 2. High IQ students did significantly better on the immediate and 

delayed* posttftests than did theW average IQ counterparts. 

3. No significant differences were observed on "either posttest 

• v . * 0 • ' 

"* between the high and low test-anxious groups. . * . 

4. Females scored significantly' better than tfid males on both 
* « posttests. 

5. The interaction of method x IQ x anxiety reached statistical 

... m» 

significance (p s <.05) for the decayed retention test. All 

*\ . * • 
remaining interactions were not significant. 
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-Interpretations 

Conclusions, inferences, and implications made by the authors are 

summarized below: * » . 

* . • 

1) Presence of a significant difference in favor of/ the deductive 

• * * / * a 

i group on -the immediate posttest and absence of/such a difference 

on the delayed posttest are consistent with pearlier findings. 

'2) A tentative suggestion, based on the findings, is that a deduc- 
tive method may prove superior for immediate retentiQn on difficult 
learning task^^wheteas .the inductive method, seems equally 

* effective for delayed retention. * f 

r 

3) If discovery learning- techniques are developed, time allotments 
are equa'l, and delayed retention is equally effective, then 
inductive learning isf. the' advantageous method. 

4. Absence of interactions among mel^hod, IQ* trait anxiety, and aex' 
may have resulted from the high degree- of structure associated 
with this learning task, . s 



* ' ; ABSTRACTORS ANALYSIS 



) ■ - 

The issue concerning the relative effjcacy of inductive and deduct 
methods is the-moSt important point of 6 this investigation. The instance 
of equal effectiveness for delayed retention Reported in this invest iga- 
tion is noteworthy because equal, allotments of tiitte were given to each 
instructional strategy." However, caution must befexercised in the results 
and generalization of these findings. The gleaming task was highly 
structured, brifef, and involved the use of aucjiotapes. 'Also' 33 percent of 
l^the students were not included in the analysis r due to missing data* 
Removal of one-third of the subjects^f rom the' analysis created a_seriou$ 
prottlem. The authors 1 note that the loss was randonrjts^dif ficutt .to 
accept without further evidence, The^participants* included in the data 
analysis jnay^nort be representative of the science clcfss from which they 
were selected, thereby making further generalisation tenuous Techniques 



for handling unequal cell frequencies in 'ANOVA were available in the mid- 
1970 f s, and such methods are more appropriate than is exclusion of cases 

due to missing data. I-t seems best to view the results of this study 

• * 

with much caution. * The findings have heuristic value, but further work 
is needed to support the evidence presented in«this study. 
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^Purpose • 

To ' investigate an hypothesize^ relationship between participation 
in SCIS and\the child's positive self-concept. \ 



Rationale * *^ 
\ 

Research studies have suggested that the learning environment, e.g., 
a humanistic emphasis, enhances the development of a strong positive self- 
poncept in students. Other studies also support the conclusion that the x 
stronger the self-concept of the student the greater the student's academic 
performance. Other variables such as gender, race and age that may enhance 
or detract^from this relationship have also been investigated*. The precise 
way in which a specific science curriculum as a context for learning influ- 
ences the dependent variable of a child's self-concept is a key concern in 
this study. 



Research Design and Procedure 



The design* was a pre-post control group where 



°1 , X A °2 



°3 X B \ 



0 = ^neasures of self concept with Pie,r Harris scale 

X A * SCIS curriculum for f 4-1/2 months 

X B w * conventional curriculum for 4-1/2 months. 
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The subjects used in this study were 189 students, third to sixth 
grades, in Indiana sqhools. The subjects were intact groups enrolled in 
eight classes, .The experimental group consisted of two randomly assigned 
classes to receive the SCIS ' curriculum at each levelT grades 3, 4, 5 and 
6, The control classes continued to have a science textbook-based 
sequence as had been their custom*. , ' ' — ; 

- ♦ % 

All the subjects were given pretest of self-concept, Piers Harris 
Scale. The, teachers weregiven the Bratt Attitude Test to ensure lack 
of bias in teacher attitude 

The treatment consisted of four and one-half months of instruction 
either in SCIS or in conventional textbook. At the end ofthe treatment 
the Piers Harris test was given agaift to all subjects. 



Findings e ( 

>? 

Using" a three-way (4 [grade] x 2 [gendfer] x 2 [treatment]) analysis- 

of variSftce, the mean- gain scores (tot^l and sex cluster) from the Piers 
Harris Scale were analyzed. ^No evidence was found that gender or grad,e 

level produced a change in child's self-concept. The type of instruc- 
tion was found to be a si^ni ficant factor/* 



Interpretation - 

For this study^ it-can be 'concluded ^that tlje science curricula can 
^be-effectively use<3 to, enhance a child's positive self-concept 2 

' ^ C 

ABSTRACTOR'S ANALYSIS 

0 

This study provides useful hints about the impact of school exper- 
iences- on students 4 self-coBcept^^Jhat school Experience would be t expect ed * 
to t show such an impact is well supported by. ttfe authors. .That schodl experi- 
ence did indeed have this impact is far. less certain. The design permits 
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only the certainty that post-instructional measures of self-concept were 

indeed 'different than the pre-instructional measure of that variable. 

What is missing is a clear measure of the validity of the independent 

variable. In what ways was t&e instructional variable aptually 

manipulated — and with what confidence can one believe # tfrat there was 

enough difference in the experimental and control treatment to attribute 

change in pre-post measure to the treatment?"" In the absence of either a 

specific description of the experimental treatment — and an indication that 

students had indeed acquired knowledge or skills, the reader is permitted 

♦ « 
only the conclusion that student performance on the measure did change ^ 

over the four and one-half month period. This is reflected in the very 

limited implications for scierfce teaching the authors were willing to 

■* 

* .make. ^ # - 
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Expanded/ abstract arid analysis prepared especially for I.S.E, by John R. 
Stayer, DePaul University. * , 



Purpose . * \ 

i •* *~ 

» ' * '* 

, Ttje purpose of £he investigators in this study was to aftswer the 4 

following questions: First, will the use of concrete exemplars in cheinis 
* ' ° 

• t*ry, instruction improve learning in chemistty? Second, is learning 
improvement related to the operational level of the student's thinking? 
The authors 1 stated 4 yiypothesi^ was that instructional methods, in which 
learners use concrete models k'nd exemplars of a concept will lead' to 

- better understanding By. students at both the concrete dnd formaf oper r a- 

\tdonal levels of cognitive development. 

A . . . . % 

. ' ^ ■ . . • ; 

Rationale ^ * 

The theoretical base of the investigation is founded in Piaset's 
theory, t>f -cognitive development. The instructional issue concerns the 
value of, marching- teaching strategies and the intellectual development 
of students for .the improvement of student learning. "*• 

. ..' - !!•.'{". " ' - - • • :. * t * 6 ' . 

Rgsjearch Design and Procedure v " 4 . * 

Ninety-fJRre £95) ^chemistry students tolled ^in a, high school whose"* 
population is largely industrial^lower-middle-class participated iirthe 
study. Each subject was a member of one of four' regular chemistry • 
" fclasses; students in the honors chemistry sect iojr were excluded. The* ' 
mean ag&'of the subjects, was 16 years, 8 months*.* * * • m 



*3* 



o '* . The four classes remained intact during the investigation; two were 

. • assigned. to the treatment group such that the two teachers providing 

instruction eiach. taught x>ne experimental and" one control class. The unit 
- f • i * . 

of instruction was stoichiometry, the first unit Aauiring chemical calcu- 
lation^ fbr these sqbjects. Before r instruct ion, the Piagetian lev^l 
each participant was' ascertained*. Next, stoichiometry instruction, control 
* and experimental/ was provided for f six weeks. After instruction, student * 
~ comprehension fit stoichiometry was .measured*. A diagram of the research 
de^si git appears in Figure 1, 



Experimental , 
* Group" 
'(2* intact classes)' 



Control 
Gtfoup* -« 
(2 intact classes) 



Piagetian 
Xevel 
•Assessment ■ 



' Piagetian 

. Leyel % — — 
Assessment 



Stoichiometry 
instruction with 
concrete models 

and exemplats 



Stoichiometry 
instruct ion with- 
out concrete models 
and exemplars 



Stoichiometry 
Post test 



Stoichiometry 
- Posttest 



.Figure, 1. — Design of the Study 
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'Assessment of the participants 1 logical • reasoning processes was done 
by a written instrument* The three sections of the written test measured 
ability to tferform the operations, of exclusion, combination, and pxopo'r?- 
tional* re^sbning. ' Section^ 1 and 2' exclusion and combination, were tak6n 
from Gray f s (1973) validated, test, whereas Section 3, proportional reason- 
ingywas adapted from,fcwo tasks designed by Karplus (197p) , "Mr* T/all-Mr. 
Short" «and "the c£r* problem. " . - • . * # ' 

* 5 • * V 

% 

' * The six-j/eek instructional p^er^od was' conducted in a lecture-response 
mode with associated" drill dnd' laboratory experiments. ' The staled princi- 

m pal* difference between the treatment and control classes involved th§ use 

af Concrete models (marshmallows, jujubees,* styrofoam balls, arid toothy 

picks) to represent atoms, molecules, , and" ibifis in stoichiometric chemical 

reactions.' Laboratory work consisted of ^ur two-hour ^fiods during , 

wliich all students performed Jthe following experiments: 1) indirect count 

•* < • » * 

of large numbers of particles, 2y determination of m the percent of water in 
a hydrate and '3) "determination ,of the» ratio of tlie( products (NaCl) to 

• . \8 \ ' • > . 



reactant (Na2C0,j) • Cqntrol classes performed an experiment to determine 
Avogadro's number by monomolecular layer method, but treatment classes 
instead worked with concrete models and 0,1 mole samples of certain ele- 
ments and compounds, to develop the idea that the mass ratio of single 
atoms of different elements is the same as the mass ratio of models of^ 
the same element. All instruction in both groups was based onthe intro- 
ductory chemistry textbook by Metcalfe, Williams and Castka (1974), 
• n 

c 

Comprehension of stoichiometry was^measured by two questions (shown x 
below) embedded in the unit exam administered to all participants follow- 
ing instruction. ~The two questions were unlike any encountered by sub- 
jects in the text or during instruct ion! They were constructed to assess 

r 

the development of a conceptual understanding of stoichiometry in con- 
tr&st with the use oi a memorized dimensional analysis algorithm in the 
solution of quantitative problems. All other items in the unit. test were 
similar to instructional examples. The chi-square statistic-^was employed 
to tesf the ,Jiull hypothesis, ' ' 

\ 

* . ' \ 

Question 1: Which, if either, has more atoms, 30 glrams of*oxygen 

or 30 grams of chlorine? Explain your answer, 

, Question 2: 35 grams of chlorine are reacted with 35 grams of 

sodium to form*HaCl. Is there exactly enough of each 
or* will sodium be, left-over or will* chlorine be left 
over? Explain your answer, * 



Findings 



i m 
A summary of the authors' stated, findings is provided below: 

1. The expected wide variation in cognitive level o# the partici- 
pants was observed (CI — early concrete: 4 percent; C2 — advanced 

? concrete: 21 percent; Fl— early formal: 35 percetit; ~F2 — 
advanced formal: ^40 percent). % ' 

2, Participants 1 scores on the. -stoichiometry comprehension posttest 
were "significantly associated (X = 25.68, df = 4, p < .0001) with 
cognitive level within the treatment ^roup, bqt posttest scores 

a - ♦ 39 r ' 

,■ . • - ,. 43 < ' 



were independent" (X 2 - 8*94, df-4, N.'s., p < .05) for subjects 
in the .control groupf * 

» * 

3. For su£je.cts classified as ^ advanced* f Ormal operational, a signi- 
. ^ *f leant ^number .in tfife treatment group achieved higher/scores on 
the posttest than their counterparts" in the control group (X * t . 
v 7.36, df = 2, p < .05). The independence hypothesis was not - 
^rejected for students classified as early formal or concrete. 



Interpretations - } m- 

+ ~ 

•The conclusions, inferences, and implications made by, the authors are 
summarized below: ' 

* * * 

1. Concrete operational students did not profit from instruction includ- 
ing concrete models and exemplars.." / 
^2. The results are unclear concerning sttidents, classified as early formal 
operational. , 4 

0 * • « 

3 Instruction wlth concrete models and exemplars was beneficial for . * 

- advanced formal £hinkers. * . ^\ 

4. Negative findings concerning .the benefits of the instructional treat- 
.rnent for concrete, leartfers cannot be attributed to poorly designed 
procedures, 

c °5. The £Lndings do not' support the view that any subject may be success- 
fully taught if concrete methods are used. 

6. Three factors* (cognitive level of the learner, conceptual level of ther 

r S * ' - t * « 

/ material, and the method of instruction) must be considered in th§\^ 
interpretation of the results. ' 9 * v 

/ /' 

7. The concepts were apparently too difficult for all but the advanced 

/ \ * 

formal thinkers. ' ' • ^-^> 

, 1$ ' *' " v f ' * * " ■ * ■ 

8* *The instructional 'jnethod was a controlling factor for- advanced formal 

students/! Concrete ^xemplars provided 4 base for formil^thought. by 

- these participants in, the experimental group, but such thinking was 
apparently. not used b^advanced formal control subjects who did not , 

v,v. hav£ sucbmodels.* 



9. The findings suggest that concrete thinkers cannot learn concepts 

that require advanced formal thought regardless of the instructional, * 
; method, but tfreruse of concrete models and exemplars by formal. 
% thinkers _£anjer^ learning of formal concepts. 

10. The first cons ideratiotr- should^ be level of thought required in the 
concepts 1 earned ,~then a reasoning Xevel^assessment of the learners. 
If .the students t do no^ yet possess the' necessary cognitive ^reasoning 
~~ ^-patt^rns, then instruction ^should be postponed or the concepts reduced* 
in abstractness until^th^y spe consistent with^trcfaformal reasoning 
\ patterns. % ' • , 



* ABSTRACTORS ANALYSIS 



The authors have provided evidence concerning a most important * 
Instructional question: Will matching the conceptual level of instruc- 
tio'n and the intellectual level of students improve learning? Whereas 
generalizations fc^ybnd the chemistry student population in the school are 
unwarranted (and the authors rightfully make none) due to the nature of 
participant selection -and as signment to groups, the findings, conclusions 
and interpretations merit discussion within the 4 limitations of the^study. 
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Three pointq of concern require deliberation. First, the planried 
instructional difference ^between tl\e treatment and! control groups was the 
use of^the aforementioned concrete models. Howeveif, control 'group parti- 
cipants-Were required to do an experimental determination of- Avogrado f s 
number by monomoleicular leiyer method, whereas *th<* experimental group 
performed' an alternate experiment. Further, the invaatieators nWted that 
Avograda\s numb er| experiment required a high degree of abstract (formal)* 
thought,^ but the>i^riiate_expe^ment seemed inherently less absllrapt. 



This represents a very substantiallllferenc^ 25 percent of' 

the time devoted ; to laboratory work during instruc'tiop* ' * V ** 

7 1 • " t 

^ The" second concern stems from the lack of detail in the description 
of the Ittreatiqgnt, Readers are merely informed of the. planned 4 ins true- 
tidnal^iffereVce i^olving^tl^^ concrete exemplars. A more 



detailed summary -of^ the frequency ai^Tttethods with which .concrete models 
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were' used during the six-week instructional period is needed, especially 
'in -view of the findings. Without knowledge of such details, readers must 
question the degree of any difference between instruction in the experi- \ 
mental and control groups. Leonard and Lowery 6.978)" have empirically 
addressed the issue .concerning differences in instructional treatments., 
and similar procedures should be an integral part of empirical effective- 
ness comparisons. The Results, however, do reveal th^t some instructional 
differences existed between the groups, but the magnitude "of that differ- 
ence cannot Be inferred from the authors' cursory description of the v 
instruction in the treatment and control groups. The central point of tne 
^second concern is this: Can the expected comprehension by concrete 
thinkers-Tin tl\e_ treatment group be better than that of their control group 

~v — _ 

counterparts, 'given this~ particular instructional treatment ai\d posttest? 
In my view, the answer is no, until the treatment is detailed. An explana- 
tion of my answer includes an integration of the authors J -posttest, the 
treatment, and the nature of cognitive 'development according to Piaget.— _ 
The *postfcest .is genuinely attest of comprehension, or. possibly applica- 
tion (Bloom, 1956) , and such cognitive thought implies a deeper .internal- 
izati6n of concepts ttiart a commitment to memory, The investigators are 

to be applauded »for setting such cognitive goals as their* le arning 

objectives. However, a problem arises with respect to the instruction and 
concrete thinkers. Possibly, an insufficient frequency and integration, of 
the , concrete models and exemplars did not allow the concrete thinkers to 
internalize stoichiometric ccmtftepts to the degree measured by- the posttest. 
It seems clear that for formal t]iinker§, the frequency and integration' was 
quite sufficient , and the i concrete models did, as the authors state, t prp- 
vide a nonsymbolic framework for 'carrying out the formal reasoning, patterns 

already within their *,capat>£tity. But a more frequent, use and elaborate 

>\ i . > i i 

degree of integration must occur for the concrete 'thinker to employ con- 

cretr e reason ing^jgatterns in the solution of such problems, especially 

without the use cff models* 

The tfyird concern is\ derived from the mental capabilities of concrete 
thirkers. Again*, in my view, the treatment possibly' did not provide 



enou 
of t 



gh integration and reduction of abs'tractness within the time frame 



he experiment for concrete thinkers to be successful on such post- 
test problems. This study was not - a training study, and the authors 
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rightfully did not expect concrete thinkers to begin using formal reason- 
ing patterns as a result of 'treatment. But, was the treatment effectivfe 
in helping concrete thinkers understand stoichioipetty via concrete 
reasoning patterns to the extent that such participants could solve post- 
test ^roblemsnat Bloom T s^(t956) comprehension or application level xrixhmrt 
concrete models? It would have .been most interesting to inspect the post- 
test results of. concrete thinkers who used t'he^models during the posttest. 

The abstract structural .relationships so apparent to formal thinkers are 

%/ * 

not obvious* to concrete thinkers. -If the concrete ■ aids are removed, the 

concrete thinker is left to consider the problem abstractly. Whereas the 

treatment was almost certainly helpful, it probably did not adequately 

prepare such subjects for the cognitive rigors of posttest. ' 

% * 

9' C * 

9 t 

The entire line of argument may be due, quite possibly, to factors 
beyond the control of the investigators. Herron (19J7) has often take^ * 
issue with the desires of reviewers and editors for brevity to the extent 
that clarity is comprised. All concerned must remember .that their goal 

s 

is to communicate as much as possible In this, case, the reader is left 
with questions due to a lack of clarity concerning^the instruction''. . 

_ * j - ^ o ♦ ^ 

The 6pp6rtuitity to consider the empirical data in this report was 
>. * 
itiost pleasing, However, a; detailed inspection revealed an inappropriate ^ 

analysis of .part of the data* The.poifit involves minimum' acceptably 

expected cell frequencies in a chi-square', contingency - table. Siefeel 

* * • * • 

(1956) notes that when t^he number of columns in the contingency table" is 

2 : m * \ 

larger than 2, the X test may be used, provided that no* njor'e than 20 

percent of the cells have an expected frequency of *16ss' than 5*, and no . 

2 ' * • 

cell has an expected -frequency of less than 1. v £ £ testes not meaning- 
ful unless these criteria are met.* Unfortunately, the expected' frequency 
falls below 5 in one-third of the cells fo % r each X 2 done. ' Siegel (19,56) 
recommends the combination of adjacent categories- to alleviate the plrcib- 
lem. Whereas -combination of adjacent categories xepj:esen£s -ait* acceptable 
statistical procedure, it should not be arbitrarily dorte. In ttfis inves-* 
tigation, the # adj'acent categories of "early formal 11 a»d '^adtfajicfed formal 11 
thinkers also represent a theoretically (psychologically) acceptable 
combination. The categories have more in common than eitfier dees IcL'th 
the "concrete" classification. 9 ' 



< 2 

When the X tests performed by the authors are" done on' the modified 
contingency table, the following results are obtained: ' 

2 1 
1. X tests remain meaningless for comparisons of cognitive level 

- and score 'within the experimental and .control groups due to the 

aforementioned criteria concerning qinimum expected cell fre-* * 

quencies. * % 

w • 4 
2^ For all formal thinkers^' the proportion oV §tude?nts in the 

experimental group whd obtained high secures is significantly 
1 

greater (X =12.92, df=2, p < ,01) than the proportion of 
control group subjects. » 

\^ In sum, the contribution of this investigation, in its .present form, 
to tthe science education literature remains unclear. The exact nature of 



the\use of concrete models and exemplars n£eds more detailed description, 
and (data require ^analysis by more appropriate methods. The score .distri- 

bution^coul4* be collapsed further by combination of adjacent categories 

\ . ' ■ • j * 

to give ^ 2*x 2 contingency table. Tfte Fisher Exact Probability Test 

{Siegel,* 1956) is an appropriate alternative to *X €oV 2x2 contingency 



tables with smail expected frequencies. Whe^the above suggestion^ or * 
other acceptable alternatives are carried out, the findings, conclusions, 
and implications. will be clarified and the contribution of this, invesjti- 
n will become mo re. lucid. * ' • . 
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IN RESPONSE TO THE ANALYSIS OF 

Goodsteirt, M. and Ann Howe, * ! The Use 'of Concrete^ethods in 
Secondaryv Chemistry Instruction, " by John R. Staver. 
Investigations in Science Education , 8(2): 37t-45, 1982. 

sr 00 . by N 

- , Madeline P. Goodstein 

Central Connecticut State College « e 
I • 4 and . ' . > ' ' 
» Ann Howe 0 'itfe * 

Syracuse University * 7 j|^ 

We would 1 " like to respond to the three points of concern stated by m 
0 Professor Staver as follows: t 

On the Difference in Instructional Treatment ' 

^ • • • >■ * - ' • : 

- r . ■ It is essential tot f this type of study, that both the control and 
^ experimental groups receive identical time periods of instruction. This 
V 'means t^hat the tlm^spetit on the special instructional treatment with 
h „ .tfe experiments Wg>,up iniist be^ equalled by time spent with the control 
* ^ T JMP"P^ % ome &fj^r^JLt" V^eatperft of the same topic' In this case, the 
us^of— h^ds-on o mo c d^s^a^4 u i^ e ^ time in the experimental treatment that 
^ w^^- % deVot^(| 0 ctor^ch n$acorfcrete activities **as oral discussion or working 
out^prpblenj^with'^he' Q6pt,rqL gro&p v . ^ 

In ;the same veinJpsosSe labbXato,ry tim^ also* was used to increase 
tfye .amount o*f ccfncxaete^sac^iYity available to experimental group. Of 
the four experiments carried put, ^nly one, the mginomolecular layer 
• experiments , -was judged* to be essentially formal rather than cdncrete. 
The hands-oa activity in this 1 experiment is rfot, in itselif productive of. 
understanding of the\i?e of aynolScule; ;^xtensive ^mathematical and,' * 
geometrical instructions are .requi,r§d to reach, the desired conclusion. 
Hence, an jsxp^riment which Uspd af mors concrete procedure *jas selected 
to use the! same time- slcji^Us ,was* filled tiy the monomoiecular^ layer ; 
experiment^ f or the controTgrpup. This tj.me period, accounted foi%s l even 
percent of! the total course'^ tame. * } ! 

On Loss ofj Detail in the Description of the " v m . 

K Instructional Treatmfent , * r ' \ $ 



4 ' 'a ■ ' 

*L , As p 



As part pi the treatment -selected for the experimental ggroup, ! 
models we^e frequently picked up and shown tp^th§ class for rather short 
periods and then put down again. Also, the models' to be u$ed in any 
.discussion were visible on tlie. fronts desk throughout t^hat/^period; some 1 
models were posted permanently on the wall: We question whethe-r any 
attempt to modify this would be useful. * 
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The editor's limitation on the length of^the article unfortunately 
forced us to eliminate ma^ry of the details^ of the instructional-, 
procedures. However, tlpre are only a specific number of places in the 
topic of stoichiometry which can be concretized with models. We believe 
that similar use of the models 'would- be > made by*any teacher offering 
secondary instruction in stoichiometry who sought to replicate this 
study. 



On the Chi Square Analysis. 



A more ^eriotfs point is the reviewer's statement that our use of 
chi square for the analysis of the data was* inappropriate, Ve cannot- 
^accept this. McNemar (1962) discusses the effect of small E's on the 
value of chi square and states th^t "the effect of smell E's in produfcing 
discontinuities is not as marked when df is 2 or more" and "there is 
evidenc| that, when df is not small, E's as low as 2 will not produce, 
misleading chi square values" (p. 218). We vould, qf course, have felt 
more confident of the results of the chi square test if we had had 
f£wer cells with low frequencies but we do not think the reported^ 
analysis^is misleading. By publishing the frequencies in a clear and 
unequivocal style we made' it possible for the reader to draw has or her . 
own ^conclusions ..about our use of statistics. and interpretation of 
>• results. The reviewer's suggestion that categories be collapsed does 
not seem to solve the problem since that wpuld obscure the distinctions 
betweenjstudents at the three cognitive levels. 

In our judgment we chose the best available alternative and we do 
*not think the results are meaningless. 

It should be remembered that we did not claim to have conducted a 
definitive experiment— it was, instead, an effort to test an idea on a 
small scale under cohditigns that exist in real classrooms. We would 
welcomcevidence from others who have been able to^ improve on our 
. methods. I * f 
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Quorn, Kerry Charles and Larry Dean Yore. "Comparison Studies of Reading 
Readiness Skills Acquisition by Different Methods: Formal Reading 
~ Readiness Program, Informal Reading Readiness Program, and ^Kinder- 
garten Science Program. 11 Science Education 62(4): 459-465, 1978, 
Descriptors — Comprehension; Elementary Education; *Instifuction; 
- * .^Kindergarten; ^Language Ability; ^Perception; *Process" Education; 
Reading Achievement; ^Reading Readiness; Science Education 
#t • 

Expanded abstract and analysis prepared especially for I.S.E. by Donald E. 
Riechard, Emory University. . . >- 



Purpose 

The primary paper^reports on two different/ but closely related experi- 
ments. s The purpose of experiment on£ was to assess the effectiveness of 

„ ' — 7^ % 

two dissimilar programs, Science — A Process Approach (S> — APA) and The First 

Talking' Alphabet (FTA) , upon the acquisition of reading readiness skills of 
kindergartners. The hypotheses tested were: • There will be no significant 



1. treatment, sex, and attendance-time main effects; 

2. interaction effects; . > 

m * 

^ 3. differences between pretest and poSttest means on any of t^e" ^ 
reading readiness measures. \ % 

* The^purpose of experiment two was to compare the effects of four 

different programs (S— APA, FTA, informal language development, and a 

control). The hypotheses tested were: There will l>e no significant 

% • 

1. ^ treatment, sex, or teacher main-effects; m 4 
4 j> * _ , , ~" , " 

2. ^interaction effects on any' of the reading. readiness measures. 



Rationale 4 

V * , ^~ . ^ * ^ 

The authors x build a rationale on published research. References are.' 

cit^d to support the following: * - ^ . z • 

' ' . • ; , ' * * ' * m 

1. There are predictive correlations of certain ^skills with later 

reading 'achievement. (Skills are listed in the primary paper.) 

* k * 

" .* . 

... 48 - , » .« 



* • I ,-.V, ' 5 '2 



2^ The skills, above, may be developed through, training. 

3.. Similarities between new kindergarten science curricula- and '* 
I * 
teactjers f informal rd&diness activities suggest that science 

procejsses and reading readiness skills are not mutually exclusive, 

4. €ert£in science activities might provide an opportunity and cli- 
mate 'for reading readiness skills acquisition.^ 



Research Design and Procedure 

■c * * 

As stated above, two different but closely .related experiments were 
presented by the authors. Designs and procedures of the experiments are 
given under separate subheadings below. 

* ■ - 

Experiment I . Fifty-one pupils from morning and afternoon kinder- 
garten classes were randomly assigned to four treatment groups. Two reading 
readiness measures, Metropolitan Readiness Test and Clytner-Barrett Ereread - 

0 V - ^ 

ing Battery , were administered on a pre- and posttest schedule. One morning 
group and one afterptfon group were randomly selecf^d for one of the: treat- 
ment programs (S — APA or FTA) . The two remaining groiips were assigned the 
other program. Treatment consisted of an ^investigator Reaching the* two 
instructional pro grams| (S<--APA and FTA) over a ten-week period.. Each group 
received 22 #alf-h<}u£ periods of instruction. * . . • ^ 



- . u ■ - , 

Upon completion -of the pretest treatment, and posttest, the reading 
readiness measures were scored. Posttest data were <^ialyzed' by a three-' 

. way analysis of variance, using treatment, .sex, and attendance time (morn- 
ing or afternoon) as th6 main dimensions. Pretest-posttest mean gain 

\ scores for each treatment, sex, and, attendance-time group were analyzed 
by correlated t-tests. • - 

. Experiment II . ^Fifty-four kindergarten pupils from one school were 

randomly assigned to t£*ee trea&ient groups and one control group. The 

* treatment groups were science, formal reading readiness, and informal* 

reading readiness. One of the' investigators conducted 14 ses^ipns with 

* • „ • 

^cl) of the treatment groups; The science sessions^ were lessons from 



S-'-APA while the formal reading readiness^ lessons were selected from*FTA. 
The informal reading readiness sessions 'were developed by one of 'the 
authors. The control group continued with, the regular kindergarten pro- 
gram.- : . ; ' v *, !j 

s * 

A posttest was administered after treatment Z' * The ppsttest consisted 
of three measures of reading readiness — the Clymer-Barrett ^rereading 
Battery ,, the Wepman Auditory Discrimination .Test , and ^ the Moe Beginning 
Consonant Sound Symbol Relationship Test , . , • * • 

NAnalysirs of data was done by means of a three-way 'analysis of 
variance with treatment^sek, and teacher as the independent variables. 
The teacher variable &as defined as the two "regular'^kindergarten ; 
tea theirs. Reading readiness was the dependent vafiable. • * • 



Findings 



Experiment I. There .were significant (p-0.05) dif ferences/in the* 

• * i *' 

following: . » - \ ^ 

1. , Attendance times on the Clymer-B>arrett discrimination , of begin- 
ni'ng sounds subtest. 

2* J Treatment -by-attendance tim§ interaction on the Metropolitan 

i * * 

' ' ] matching subtest. - _ 

3. Treatment -by-sex-by-attendance time interaction on the Metro- 
politan copy subtest. ■ * 

yvjh^ x-test analysis of gains between pretest ana ppsttest-'nieans 
/yielded 51 significant (p ^ 0.0&) findings and.^5 at or, greater than the 

0.10 level of probability; These data are given by table in the primary, 
^article*. ^ ' . -* > <p 

* \ "/ * 7 

' Expexrim&nt JJ; . 'Result^may be ' summarized as folldws:* 

- ' • '* J , ^>^*t ■ 

1. Significant (j> # - 0.05) teacher effects Were found for the* audi - 

' tory discrimination section of the Clymer-Barrett / 



2/° A significant ~(p - 0.05) sex effect wife found for the Wepman 



Test of Auditory Discrimination. t * ^ 



% 

% *3. No significant N treatment differences or interaction effects 
» * were found." • « • # * " 

HO* * " - ,' 

# . ' ft ■ • • » < 

- * , V -* 

• HP * * • - * 

• » « 0 

? ■ , - 

Interpr etatio ns * 

<x — 45 — ' 4. <■ 3» ^ A 

The authors summarise their research by the following: * 



♦ 1. The effectiveness firf kindergarten* science activities on reading 

^readiness developmerft cannot be supported -conclusively by these 
£ * * studies. - « 

2% The theoretical links between reading and tjie science processes^ 
- . ♦ • ( • ' 48 / 

-i-K>bSeyvihg, inferring, and classifying--rtere .not evident in 'the 

* empirical data. „ * • 

• . . • • v ^ 4 — 

♦ % 3^ Kindergarten science activities effectively (Jevelop science 
skills.. without interfering with reading readiness attainment, 

* Thus, science* activities may be 'reasonably included in , the ~ 
curriculum even though tlieir effectiveness for reading readiness 
development has not been demonstrated. f s 

* • ABSTRACTOR'S ANALYSIS • m * 

. -At * -v • ' . 

. Contributions of the^Study 

The authors 1 summary of f indies (above) raises questions about the 
-** * , 

contributions of this study to existing knowledge on relationships*, between 

reading readiness and science experiences. , Is this a unique case Qfi inves 

tig^Eors being a bit overly* conservative in interpreting* their/data? 



At any r^te, the.,stud^does prbvidj^ useful insJ.ght^Lnto methodology 4 
for researchfwith young 'children. Furtl^, It^uggests some lessons on 
interpreting data and preparing written rftpor*ts. y$ 



R&earcti Design and Validity , * - 

The pretest-treatment -posttest design used in experiment one seems 
adequate for the specific purposes, stated. However, the report does not 
indicate if a- comparison of. pretest scores of the different groups was 
made. Random assignment, to treatments was used and each "treatment con- 
f tained a ffiorning and afternqpn group. Still, it would be helpful in 
analyzing results to know how the groups compared ^rior to treatment. 

Experiment two was conducted with treatment -posttests only'; no pre- 

/ 

tests were administered. Again, despite randomization, the question of 
group comparisons before treatment is raided. . , 

Several other questions are related to design and procedure. Among 



them are the following^ 




l" Was the same school used 'in experiment one and experiment two? . 
■ 3>f so, were any of the same children used in both experiments? 
Were 'the* same "regular" teachers involved in both experiments?^ 

2. In experiment one, v^re morning and afternoon classes taught by 
the same "regular" teacher, or* were different "regular"' teachers 

• involved? The teacher variable was x significant on some measures 
in experiment two. ^fc , " .. *" 

3. Did experiment two -use both morning and afternoon groups?- Atten- 
dance time (morning or*afternoon) was significant on some measures 
in experiment one, 

4\ How long did experiment two last? Experiment* one lasted 10 weeks. 
— ^he authors' suggest that experiments of this "nature which are' 
concluded in a short period of time are less likely to produce 
significarit results than experiments running an entire year. 



Research in Early Childhood - 
~ : ' * 

The ,design of the study indicates a sensitivity to some of the special 
'problems 'encountered in early childhood research. Good efforts were made 

52 



at randomization and assignment to treatment 'and, attendance-time groups. 
Also, i treatment and testing were rotated across groups. Such rotation 
can minimize the influence of extraneous variables such as children's 
attention spans,, fatigue, eating hab.it s, fc napping and play patterns, and 



******** 



so on. 



The .paper does not indicate if chilftgen. were familiar with the 
investigators but this is also* a factor to be considered. It is some- 
times advisable for a stranger to make several !! rapport visits 11 before 
actually beginning an experimental treatment and/or testing with young 
children. 



Interpreting Results 

' TV 

The authors were very conservative in drawing conclusions arid inter- 
preting results* ( In general, brevity and caution in -interpreting behavioral 
research are highly commendable, tare must be taken, however, .-not to over- 
look relationships or inadequately analyze data fpr the sake of concise and 
cautious reporting. 

Quite appropriately, the Investigators do riot overgeneralize or i^tke 
statements no£ fully supported by the data. They even question some of 
jpieir statistically signif icanWfcadings and suggest that the results be 
"viewed with suspicion. 11 4 

Another example^ of caution is in the summary statement that "kinder- 
garten science activities effectiveness^ reading- rpadiness cannot be- 
supported conclusively by these studies. The theoretical linjcs between : 
reading and the science processes. . .were "not evident in the empirical > * 
data." These conclusions -are made despite the large number of significant ' 
pretest. to posttest gains "in reading performance by the S— APA groups in 
experiment one. Since similar gains weremade by the FTA groups,. the 
authors allotf only that both programs .produced similaif jtyi>es of achieve- 
ment and that further research is needed to isolate'' the significant 
variables. 



r 



Written Report * 



At .times it, was 'difficult for this abstractor to follow the two / 
different experiments, in one articie. peeping track of purposes, treat- 
ments, teachers/ g^ups, results, et cetera, for each experiment was 
bothersome* Publication .of two separate reports would have made efasier 
reading and might have permitted a more thorough presentation of /data 
and analysis of results. 



Null hypotheses were stated for each of the experiments./ However, 

in the interpretation of data/ no mention -was made of the hypotheses. 

Direct reference* to previously listed hypotheses, and a statement about 

the acceptance or rejection of each can be an -excellent starting place 

for discussion of results. The writer of the^report then has something 

specific to focus upon as conclusions and interpretations are made. 

r 

Such a focus reduces the chances of over-interpr etat ion of data, and, 
conversely, reduces the chances of under-interpretation (too cautious, 
an 'interpretation) asowell . . 
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IN RESPONSE TO THE ANALYSIS OF 

Quorn,* Kerry C. and Larry D. Yore. "Comparison Studies of Reading ' 

Readinesfe Skills Acquisition by Different Methods: Formal Reading 
Readiness Rrogram, Informal Reading Readiness Program, and' a 
Kiqdergraten Science Program" by Donald E. Riechard. 
Investigations in. Science Education , 8(2): 48-54, 1982. 

by\ ° 

Larry D. Yore 
^ . University of Victoria 



The opening comments regarding the contributions and conservative 
interpretation of the data appear to be unsubstantiated by the majority 
of the related criticisms. Surely two independent studies with rather 
consistent findings and reasonable design and limitations make some , 
contributions "to existing knowledge on relationships between reading 
readiness and science experiences." The critical question appears to *be 
whether science educators can # make unconditional claim's regarding 
science experience's influence on reading achievement. Several 
researchers 'have found significant correlations* and differences favoring 
activity science (Ayers and. Mason, 1969, Kellogg, 1971 ; Morgan, 
Rachelson arid Lloyd ,* 1977; Esler and Midgett, 1978), but others have not 
found such results' (Ritz and Raven, 1970). Couple these inconsistent 4 
findings with the likelihood the nonsignificant results are less likely 
to be published and one sees a cloudy picture of the reading-science 
question. As a science educator I would have been most pleased to 
publish results that enh'ance the position of science in the elementary 
school curriculum. However, mV research results did not support such an 
interpretation. * . 



The issue concerning "conservative interpretation tX *must be viewed in 
terms of statistical expectation regarding rejection levels and the 
contribution of chance in finding significant differences (Hays, 1963, 
pp. 167-171). , Jn Experiment I three-way analyses of variance were run 
of 14 measures of reading readiness, i.e., treatment, sex, attendance 
time*, . treatment x sex, treatment x' attendance time, sex x attendance 
time, treatment x sex x attendance time. Therefore-, on each measure of 
the dependent variable seven different hypotheses were tested, resulting 
in a total of 98 tests (7.x 14 s 98). With a 'rejection level of 5 
percent (*£0.50), one would expect five significant differences in 
^100 tests purely due to chance. Therefore, when testing 98 hypotheses 
one should not be surpri'sed^to get 1, 2, 3, 4, or even 5 significant 
differences^ -On the other hand, if a small number of significant 
differences outline a rather consistent pattern, then greater concern , 
should be expressed. Spcbr-a consistent pattern was outlined by the 
teacher factor in Experiment II. Three-way analyses of variance were * 
run on 12 measures of , the dependent. varidble^_thus .84 -tests-were run (7 
x 12 = 84) with a rejection ^Level of ,5 percent (•vf 0.05). The 
expectation v was that four significant differences would be found due to 
chance. The analysis of data in Experiment II yielded four significant 
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differences but three of these involved the teacher factor favoring a 
more structured approach. 

Design and Validity ? * 

The concern regarding the analysis of pretest data to assess equivalence 
of the random samples in Experiment I was a noticeable weakness in 
reporting. A complete analysis of pretests were completed and reported 
in the more complete document (Yore, 1973/ pp. 55-61). The analysis of 
variance on pretest data yielded two significant (p , . 0.05) differences 
on the 98 hypotheses tested. Only the attendance time x treatment x sex 
interactions for Clymer-Barrett Beginning sounds and Word Matching were 
found to be significantly (p 0.05) different. 

Since random samples were used, differences that existed were attributed 
to chance and the random sampling fulfilled the assumption of the ANOVA. 
On* the other hand, since Experiment I used a pre-post test design, the 
descriptive statistics or summary of results should have been provided 
for the reader. Experiment II attempted to avoid the pretest-treatment 
interaction and test-retest effect; therefore, no analysis of, pretest 
was possible and is not a legitimate criticism since the pretest was > 
removed to increase the external validity of the design (Campbell and 
Stanley, "1963). - 

Concern regarding the school populations are implicitly answered with 
the mention of "kindergarten class (es) of a Victoria, British Columbia, 
Canada, public school" (Quorn and Jore, p. 460) for Experiment I and 
"kindergarten pupils C54) from a school near Victoria, British Columbia 
(Quorn and Yore, p. 462) for Experiment II. The key operants "of " -and 
"near" indicate, that different schools were used, therefore' different 
teachers and pupils. 

The pupils in Experiment I were taught by 'the same teacher, which allows 
for a three-way analysis of variance rather than four-way. In 
Experiment II two kindergarten^ classes which met simultaneously with 
different teachers were used as the sample. The simultaneous attendance 
allowed the disregaUd of attendance time and the addition of a teacher 
factor in the three-way ana-lysis of variance. In both 1 experiments, 
subjects were randomly assigned' to groups and-,the groups were randomly 

assigned a treatment. 

v „ . 

The investigator conducted 14 instructional sessions with tfie assigned 
treatments over a 12-week duration in Experiment II. In Experiment 1 a 
four-week physical education (tumbling) unit was conducted by the 
investigator prior to the pretesting to* establish* rapport with the 
students'. In Experiment . II the investigator visited the classes 
regularly for a month prior to the start of the treatments. 

K * ' " ■ » r . ' 

• . • % . . 

Da rrTSalys island Interpreting Results 

The comments . that "care must be taken, however, not to overlook ' 
relationships or inadequately analyze data for the sake of concise and 
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cautious reporting" is viewed with interest. The choicfe of statistical 
analysis was built into the design of both experiments a priori and* the- 
underlying assumption of the specific statistics were considered. 
Alternative statistical technique could have been used, such as in - 
Experiment' I— an analysis of covariance (Campbell and Stanley ,' 19630 . 
The statistics were chosen ofi the advice of Statistical • consultants at 
three different universities (Victoria, Minnesota,. and Washington 
-Stated i . . . 

The concern regarding conservative interpretation is a criticism that, ^ 
may be taken by many as a positive attribute. The large number of . 
significant pre-post test gains suggest that learning occurred over the > 
duration of Experiment I. The lack of significant differences between' 
treatments prevented any specific identification of the possible cause. 
The design of Experiment I did not allow the investigators to partition -* 
the variance down to resultant components. It was believed that the 
test-retest effect, the regular kindergarten program and outside * \ 
influences contributed so much variance that the variances due 'to the 
specific treatments were inconsequential. The design of Expetlnteht II 
attempted to factor out some of the effects. Unfortunately the regular 
program was not significantly different from the other tjiree treatments, 
ft was judged responsible not to interpret/ too liberally since~ttie data 
and analyses appear rather consistent. , . 

Given this opportunity to expand on the original interpretation, it 
appears that a potentially strong outside influence that might havo, 
discounted the effect of the treatments is television available in • 
Victoria, British Columbia, Canada. Victoria is located near the 
USA-Canada border and hafs 12 channels of US and Canadian TV available 
for viewing-. Several channels carry educational programs for young 
children, i.e.; CBC, CTV, PBS and the US rfational networks. Reading 
readiness programs like "Sesame^Street" viewed several times might be 
discounting the effect of formal in-school readiness* programs . 
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Laboratory Experiments* and Student Aptitude on Achievement and Time 
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' Research in Science Teaching 15(6): 455-463, 197&, J 
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Expanded abstract and analysis prepared especially for I,S,E, v by 
Joseph C\ Cotham, '.Indiana University-Bloonrington, 



Purpose 



* This study investigated the effectiveness of ^computer simulated - 
laboratory experiences in a college chemistry laboratory course. The 
following null hypotheses were. tested: • ■ 

1/ There is no significant difference in achievement or time tp 
complete" the experiment of students doing a simulated or labor- 
atory experiment, • - 

2. ' There is no significant difference* in aSJjieyement or time to 

complete the experiment and calculations of students of 
different aptitude. v , 

3, There } is.no significant interaction between experiment type 'and 
student aptitude. 



Rationale - - ( 

The authors cite current- interest in' computer r assisted instruction , 
(CAI) and computer simulated experiments (CSE) as possible means of 
improving student learning and providing . for individual differences, 
Re^nt interest in microcomputer applications in the schpols and the ° 
increasing accessibility of these systems does, indeed, emphasize the 
importance of generating 4 a sound empirical basis for decisions concern- 
ing the use of computer systems in instruction. Evidence exists to ^ 
support the use of CSE in place of laboratory experiments in high school, 
the use of CAI to teach the operation of an instrument, and the use of 
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CAI in supplementing, co Mege chemistry coursework. This -study attempted 
to extend understanding of the utility of CSE in college chemistry 'labor- 
atory instruction. An important 'aspect Qf this understanding, emphasized 
in the authors* rationale, is the relationship between aptitude and teach- 
ing method. 



Research Design and Procedure • . ■ • 

The hypotheses of this' study were tested using a. 2 x 2 factorial 
design (posttest_ x only or time).* The factors were method of cfoing the 
experiment (simulation or laboratory) and student aptitude (high or low 
scores on the SAT). The dependent variables were scores on written ^ 
achievement tests, the time required to do the experiment, time required, 
to perform experimental calculations, and in one test, achievement (score 
and time) on a' performance test/ Uhe achievement tests/were multiple 
choice instruments of varying lengths.' The content validity of these 
.tests was estimated informally using consultation with subject-matter^ 
experts. Reliability vas estimated with the KR20 and , Spearman-Brown 
formulas (values for. the 10 tests ranged from .61 to .89). The perfor- 
mance test, which was administered individually, was based on a checklist 
of observable behaviors required to make a spectrophotometer measurement 
on a solution. _ 

• ~~ ~" - — , 

sample consisted of- students enrolled in an introductory-ehenjis- 

try course at The University of Texas in the fall of 1976. The course 

consisted o/ multiple laboratory sections which* were offered at four 

different time periods^. Pairs of laboratory/simulation ^experiments for 

each course topic (refer to Table I) were prepared and randomly assigned 

to each time period. Within ea'ch time period laboratory sections were 

randomly assigned to either a ■ laboratory, or simulation experiment. The 

number of different sections involved in ^ach treatment was not reported. 

Absence of bias in'the registration, of students in one section or another 

within a time period was assumed .and used to justify .failure to randomly 

assign students to treatments. The treatments*,,, which Were only briefly 

^described, appear'to differ significantly in ways not attributable a tp 

type of experim^ht. 4 For^exampl.e, the simulated* experiment for Group 1 
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involved a spectrophotometer^ but the laboratory experiment did not. 
Also, treatments were administered in different laboratory sections. 
It was not clear from the 'report what steps were taken- to d^al with 
the threat to internal validity implied by this arrangement. 

TABLE I 
Sequence of Course Topics 4 

Group Topic 

A 

1 Kinetics 

2 Wavelength of maximum absorbance, Beer's* law, and a deter- 
miaation of cppper concentration 

3 ^ ^ Element identification using emission spectroscopy 

4 Beer's law and equilibrium constant determination 



Dependent measures were administered at the conclusion of each experi- 
ment. Results were analyzed using a two-way analysis of varfance. 



Findings > 

The following findings were reported: K v 

\ ■ 

1. Based on achievement on written tests, students who clid the 
simulation in Group 4 performed significantly better than 
students who did the laboratory experiment. Also, students 
who did the' simulation in Group 2 performed *signif icantly 
better on one dependent measure than students who did the 
-laboratory experiment. *No significant differences between 
experiment types were found for scores on the performance 

% test taken by Gr$up 2. v 

\ • * 

2. Students who did .the simulated experiments in Groups 1 and 4 
used significantly less time to perform the experiments than 
did studepts in the labo££feory. However, students who did 

the laboratory experiments in Groups 1 and 3 used significantly 
less time for the calculations. 
'* 61 
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'3. Students in the higher aptitude groups -performed significantly 
better on all written tests than studjents in the lower apti- 
tudei group, • - 

* e 

4. Even though no significant aptitude 'by treatment interactions 
^were fojjnd (at the 0.05 level), evidence of ordinal interac- 
tion was% obtained from one test from both Group 1 and Group 2 

(greater increase for low aptitude group) , Evidence of dis- - 

• w ~ * 

ordinal interaction was obtained from values of time to do the 
f "experiment for Group 4 (less time for low aptitude group in 
laboratory treatment) 9 



Interprets ions m 

t 

4 " 

, 4 

The authors, consider their study to be one experiment with three 

replications'. Consequently, on the basis of significantly better^per- 

^formances in some of the' experiments , they conclude that the ureof CSE 

in place of laboratory experiments in college chemistry laboratory is 

* j * \ 

Supported • The conclusion that higher-aptitude students .perform signi- 

"ficantly better on all written* tests is consistent with previous \ 

studies.' Lack of significant differences on the performance test which 

Required spectrophotometer manipulation was used to support* the asser- 

'tion that CSE can be used to teach ttfe us§ ,of some types of laboratory 

instruments. The authors provided a detailed explanation of the 

observed differences in time to perform the experiment ««rtEJ time to 

perform experimental calculations. "*They speculated that the simulation 

subgroups of Groups 1 and 3 required more calculation time because the 

calculations they were required to perform were more complicatecNthan* 

the calculations done by tVfk laboratory subgroups. The interaction 

results, although only suggestive, agree with previous results at the 

elementary level (Martin, 1973), indicating ,that CSE may be especially 

tis^fulfor low-aptitude students. 
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■ . 'ABSTRACTOR'S ANALYSIS • * ' . 

• • • • *' 

The laboratory, possiBly the hallmark of science education, deserves 
the critical scrutiny^empjLified by this study pf the effect of tfeachinf, 
method aiid altitude on ? achievement in a college chemistry lat> 
course. It is worthwhile, as an introduction to the analysis of this » 
study, to refer £b a landmark study of laboratory teaching conducted &f • 

' Yager, Englen, and Snider (1969)/ On the bas^s of this study of differ- 
ent methods of 'teaching* an adapted version of the BSCS Blue' version to 
eighth jyraders, it was Voncluded^ that the 1'aboratory approach provided no 

' m^surable advantages over other, modes of .instruction except in Jthe' 

d^relopment o^ laboratory skills. Cavin and Lagowski, in their study of 

* i \ 90 
college laboratory instruction^onciude that on all measures except time 

CSE accomplishes as much (if not more) than laboratory experiments — even 

♦ in the development of laboratory skills] Are we then to conclude that the 

advent 'of CSE has sounded the death knell of laboratory experiences? 

Before any suctAconclusion can be made, it is necessary to examine some 

of the characteristics of this study more closely. 

A notorious problem in studies of the effects of particular teaching 

methods is j^ilure to adequately c^esrcribe the method studied. The stutiy 

, addressed by this. abstract suffers from this deficiency. What distTn- 

guishes a CSE experiment from a laboratory experiment? *R*e/ Simula ted 

experiments for Groups 1, 2 and 4 involved manipula&io.a of* a spectrophoto\ 

meter. Iff , both CSE and laboratory* experiments involve manipulation of 

•* ' 
laboratory instruments, what are the distinctive features 6f CSE that 

commend it to our use? The authors, to their credit, cite the importance 
4 of attending to the type of chemistry experiment that is, simulated. The 
experiments in ^heii^study were conducive to simulation because they 
involved use of instrtiments.^^And^et^rwt all aspects of instrument 
use were simulated because instruments w^re^used in some simulated exper- 
iments. A fuller description of the study 1 s^treatltent^ would have dis- 
pelled some of these ambiguities. 



Another difficulty in interpreting-the-rasul-ts-of— ttasretady~afe 

the pot^ytial threats to internal validity that wereVreferred to earlier. 
The existence of multiple laboratojry sections .implies that treatments 
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were administered by different instructors. Was anything done to counter 
the Qpnfbunding effecf-s of the ipstructor*on treatments? And what steps 
were taken *to~^isure that' diifferent administrations of the sane treat- 
ment were uniform?, This is especially salient for the sections receiv- " 
ing the laboratory experiments because <xfi ~tjie presumed instructor inter- 
action with this treatment. „ Failure to randomly assign students to 
treatments,* although understandable under the naturalistic" constraints 
of the- experiment, deserves more comment. assumption of l&ck'-of 

bias in distribution of students .among sections may be valid, ffut situa- 
tions exist where students in a particular program (e.g„", elementary 
education majors) end up in one* or only a few sections of a course due to 
scheduling requirements. Was this tfftssibility investigated?- -If so, its. 
discussion would have assisted in interpreting the study. 

A number of tests werfe-used in this study' (10 written tests and 1 
performance ^est) . However, their" focus appears limited to jco^nit^ve 
and psychomotor domains. It may have been an interesting addition, to 
this study to assess students 1 attitudes toward chemistry and teaching 
method. These findings could provide useful insight into the utility 
of CSE. - 

' ' \ J ' 'V ■ • ' ' 

-The authors of this study devotfe considerable attention to the ^ 
dependent variable, ti*e:^ -both time to perform* the experiments and time 
to do experimental calculations, Tfcis is • appropriate because the labor- 
atory has- been frequently criticized as being too time consuming. How- 
ever, the authors 1 careful analysis of this part of -t'fie study' does 
little more than emphasize the uncontrolled differences between treat- . 

merit's that confound any attempt to interpret the observed time differ- 

. * * 

ences. Otfce ^gain, a 'fuller explanation of r the two treatments would 

* * / 
have facilitated. unambiguous interpretation of experimental results. 

\ 

' * In conclusion, this study provides a valuable contribution to 



research 'on the use of CSE in science instruction. The .authors were 

ambitious in characterizing their study* as oq£ -experiment with three 

replications. The existence of substantial differences' in treatments 

* ** 
characterized as identical vitiates this* claim. The results of t*hi£ 



study .certainly suggest, however, that CSE may supplement or replace 
certairi types of laboratory experience in the achievement of partic'u- • . 
lar cognitive and psychomotor 'objectives. Continuation of this 
research, w£th the recommendation that a more rigorous experimental 
app'roach be employed, is encouraged, 4 • * ' 




' _ REFERENCES . 

Martin, G, R. TIES Research Project Report: The 1972-73 Drill 'and 
v* Practice Study , ■ St, Paul, Minnesota:; Minnesota School Districts 
Data Processing Joint Board, 1973, 

Yager, R, E.; H, B, Engien; and B, C. Sfiider,-, "Effects of the 
^ Laboratory and Demonstration tyfttTfods Upon the Outcomes of Instruc- 
tion in Secondary Biology," Journal of Research iq Science Teaching 



> 



IN RESPONSE TO THE ANALYSIS OF 

Caving Claudia S. and J. J. iagovski. "Effectj of Computer Simulated 
or Laboratory Experiments and Student Aptitude on Achievement and 
Time in a College General Chemistry Laboratory Course," by Joseph 
Cotham. Investigations in Science Education^ 8(2) : '59^65, 1982^ 



by 



c Claudia S. Cavin and J. J. Lagowski 

The University of Texas f 

We\would like to make the following comments on^and 'clarifications .to 
£he abstract ancf^wialysis ,in* I .S.E. 

Treatments —A description of the individual experiments may be found iii- 
^ / Cavin, C. S.; E. D. Cavin; and, J. J. Lagowski, "A Study of the Efficacy -> 

of Computer-Simulated Laboratory Experiments , M Journal of ' 
Chemical Education 55: 602, 1978 (reprint available on request) or 
Cavin, Claudia ; , A Study of Some Computer-Simulate^ Experiments in a 
\ College General Chemistry Laboratory Course , Doctoral dissertation, 

University of Texas at Austin, * 1977. T^e differences in treatment, ; 
which may be more meaningful on reading a detailed .description, were, 
prompted by the requirements of the tyo different instructional 
y^^- methods— i.e. , Laboratory, and computer. T& the example cited in the 

abstract, the laboratory experiment involved observation of -a color \ 
change, the simulation o'f which would not. have # been meaningful" on a fc 
hard-copy computer -terminal . ' In' any case, the tests used for comparison 
,* ( related' only to those aspects which were copnon^to bottTmethods of 

performing the experiment. ^ 

S , 

1 Student enrollment and scheduling requirements —It was sugges£ecT in the 
analysis .that students in specific 'programs might ha^e scheduling \ 
requirements that would influefice the laboratory section "in wlii.ch they 
{enrolled. These requirements would sedto to he on the basis of trfne, and 
it is for this^season that vfl£ restricted the study of a particular 
experiment comparison to a given time period.' We had no reason to 
, ; Relieve that there >was any 'registration bias for laboratory" section in 
. . the* same time period. * t ->-^ 
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Two models of the structure of concepts in electromagnetism were* 
compared with the science graduate studfents' cognitive structure of th6 
same concepts* 



Rationale . * 

The manner in which oracepts in science are presented is strongly 
dependent on the structure of the subject matter. In turn, learning, of 
•the concepts depends on the cognitive structure > of students* An * 
important question is: Are these two structures similar?, 




Preece investigated :the answer to this question for the basijc concepts 
of electromagnetism. The present work wap oTne of a series of studies on 
the relation between subject-matter structure and cognitive structure. 

As With other similar studies ?this one w£s empirical. No mode], was 
assumed for the students 1 cognitive structure or for how. the students . 
may have reached the present cognitive state. Instead, data were ' 
.collected, and results compared to models of ther subject matter 
structure. * » '* * , 



Research Design and^Prcicedure • 

Two models of the relationship among the concepts in electromagnetism 
were constructed. A spatial modfel was derived by comparing the 
dimensions of basic units (length, time, jnass ai\d current) for each fit 
"the 15 concepts. By, assigning a point in a four-dimensional "units 
space" fo* each concept, the distances *bjetween concepts were established 

The segond model, a^digraph model, began' with electric current as ^ 
central concept. Using the defining relations the other ^concepts were 
related gfaphically* to the. current and/or the other ^oncepts derived ' 
from it. A two-dimensional graph %£ the subject-matter structure 
resulted. * ' * "i V 

• ■ * <> 

lojc each .model a matrix of concept proximity*was established- 

These two models we£e compared with the cognitive structure o? 28 
university science graduates who were studying to become physics teaghfer 
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A word-association test % asked the subjects to "respond with, five words 
most closely associated with each, of the 15 concepts of electromagnetism. 
The data were analyzed by assigning indices of response hierarchy overlap 
to the gubjects 1 responses. ^ThesV indices are used as measures of the 
semantic proximity (^£.the stimuli. A matrix of concept proximity was, 
thus, established % for each student. 

For comparision with the models a matrix of faean values was determined 
from the individual matrices. Correlation coefficients between the mean 
matrix and each of the model matrices were calculated. Graphical '* 
comparisons were also completed for the digraph mode]^ 

, ••»-«' » , 

» 7 % 

Findings 

A very high correlation (0.80) was obtained between the digraph model 

matrix and the subject's 1 proximity matrix. Essentially no correlation 

(0.24) existed betweeif the* spatial model matrix and the proximity matrix. 

A graphical analysis of the .subjects 1 proximity matrix yielded a 
representation of the subject-matter structure whiqh was very similar 
to the digraph model. This representation contained three distinct 
groups — current, electricity, electrostatics and magnetism. 



Interpretations . , 

> 

/The digtaph model which contained a pivotal concept,, electri'c ^current 
was mor.e closely* related to the subjects 1 cognitive structure, than the 
other model. Thi^* result' may be' an indication that emphasis on central \ 
ideas can be useful in teaching science. . The results .further indicate 
that a digraph model is a more appropriate method of representing student 
cognitive structures . ^ 

All but two^of the subjects had received degrees in pbyfcics. The study 
^upfcorts th£ idea that 4 student s^jghj^se cognitive structur e la tches* .the* 
experts are more ^likely to Succeed. 



, • ; . ABSTRACTOR'S ANALYSIS 

* . ' 

The concepts in any branch of science are related to each* other by a • 
structure .which develops over* many years. $hile logical development of 
the concepts contributes most strongly, tradition and history* also are 
involved in determining the subject matter structure. Once this 
structure is .established, textbook authors and teachers seldom deviate- 
from it. In presenting ^pneepts , the structure is followed as* if all 
students already have the- ilecessary cognitive structure and just need to 
fill in-'the blanks. * 

Perhaps, no science is . more* rigidly struottired in its teaching than 
physics. The "vast majority of physics courses and texts follow some 
general plan in developing concepts 1 . The structure, is sufficiently well 
established that a physics text which deviates from ltTseldom survives 
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to a. second edition. ^Thus, it is appropriate to compare the structure 
of physics v <with students^ ^cognitive structure. 



The present paper is one of several recent studires^ relating science 
students 1 cognitive structure to the structure^of^physics . Previous 
work, mostly on mechanics concepts, resulted in very similar conclusions. 
A two-or three-dimensional graphical model of the subject matter structure 
/ is able to describe the students 1 cognitive structure. 

The most interesting conclusion of these studies is the" form of the 
structure the students assign to a central location on key concept. 
All other corfcepts seem to be, in some sense, derived from this one. 
Further, the concepts seem to be groupfed by the students in a few clusters. 
Thus^ physics teachers could learn about ways to organize and structure 
teaching. « * 

While the clusters and central concept are interesting, they are at the 
same time disappointing. In the present study, and in earlier work on** 
mechanics, the central ^concepts are the ones most emphasized by physicists. 
The ideas of mechanical force and -electrical current are presented many 
times through physits. Likewise , the clusters represent chapters or 
sections of a physics book. The material seems 'to be organized in the 
4 students' 'minds the way it was taught to them.* Successful physics 
students seem to have a cognitive structure 'very similar to the experts. 

The next important question* in this research area is: How do* the students 
obtain this cognitive structure? Perhaps, science courses filter out 
all students whose cognitive structure differs from the "norm." Perhaps, 
science students enter a science course with a different structure, and 
structure must be changed to fit the norm. These possibilities have not 
.been addressed sufficiently in any research' on subject matter and cognitive 
structures. • * 



Eveti more interesting than the cognitive sti^ucture of scfence students 
' *is that of nonscience students or beginning science students. Most 
te&chers'of scierfce .treat these groups as if. they have the same cognitive 
structure as scientists . r The courses and textbooks, with a few notable 
exceptions, are structured the same for all types of students. Only - the 
'details such as level of mathematics differs?*. No rational defense for 
the assumption o,f similar 'Cognitive structures can be made. 

.Some evidence for, differences^ is beTginning to emerge. * Some' recent 
efforts indicate that students 1 preconceptions about physics concepts . 
are much different from, those. j3f_ , physicists . How these preconceptions " 
lit into the .pognitive structure is -yet to T>e determined/ 4 

To learn about the cognitive structure of nonscience or beginning* science 
'..students, research designs different from the present study must be 
used. Word associations have little meaning for students who" do not know' 
the language of science but have heard the same words in other contents. 
Comparisons^with models -acc'eptabl^ to experts may lead to conclusions 
that no structure .exists when one does/ * ' 
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We mustuJLearn how students organize the thousands of everyday experiences 
related to science. The task will be difficult one for science-oriented f 
researchers to undertake. But, it has tremendous payoffs. We can learn 
to talk about science to all those people who say they, hate *it. ' 
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IN RESPONSE TO THE ANALYSIS OF 



Preece, P.F.W. "The Concepts of Electromagnetism: A Study of the 
^Internal Representation of External Structures 11 by Dean Zollman. 
Investigations in Science Education , 8(2):- 67-70, 1982. 

by ' / * 

P.F.W. Preece 
University of Exeter 

I should like to comment briefly' on one issue raised by Zollman in his 
very useful and balanced analysis of my paper (Predce, 1976c). He notes 
that the cognitive structures of nonscience and of beginning science 
students ar<* of particular interest, but claims that word-association 
methods are .inappropriate for investigating such students. Although 
word-association methods are relatively crude instruments for exploring 
cognitive structures and the* development of more; sensitive techniques 
would be' very welcome, they have certain advantages particularly for 
students with little formal experience of the subject matter. Johnson 
(1969) noted that problem-solving *test§ were unsuitable for students 
whose knowledge of concepts could not be expressed as a solution 
sequence, but that word-association. methods did not suffer from this * 
disadvantage. Moreoever, it seems.^that word associations are 
particularly sensitive to the early stages of learning (Rothkopf and 
Thurner, 197Q; Shavelson, U973). 'Deese (19,65) also argued that 
word-association methods we're not contaminated by arithmetical 
competence or by the rote memorization of examples .and wereSsierefore 
particularly suitable in studies of scientific concepts" J 

ZojLlnah argues that "w,ord associations have little meaning for students 
who" do not kriow the language of science but have heard the same words in 
qther contexts*" But it is a great merit of th£ free word-association 
test that it permits the exploration- of the everyday meanings of words, 
if -these predominate • in f .students f 'memories ;**Thus the issue raised by 
Zollman of the possible mismatch between beginning students 1 
preconceptions of physics and the subject-matter structure, can be 
investigated by the word-association" technique . * 

s . ' ^ " 

I should like to illustrate: 'this by some research*carried out in Exeter 
(Preece, 1976a).. A continued f reeword-association test was* used £o 
explore, the mechanics. cognitiveLstructures* of ironsciehce graduates and 
also of physics students throughout the period of learning that subject 
at school arid university. TJie cognitive structures of the adult 
conscience group and of* the 12 year-old beginning physics students were, 
closely similar, these struqtu£es reflecting the everyday, nontechnical, 
meanings of .the science concept words, For both groups, three clusters 
of concepts— kinematics, statics, and energy—emerged in the graphic 
analyses, although a nomberjbf qoncepts, including distance , time , and 
work, .remained unconnected. \ For the school, and university groups most 
knowledgeable in physics al]l mechanics concepts were interconnected, 
the^ three. clusters be£na linked together by < the' concept force . Further 



insight into the crystallization of these structures from the concrete, 
intuitive, and isolated concept^ of childhood was provided by multi- 
dimensional scaling analyses (Preece, 1976b). 

In the Exeter research,, the, empirical interconcept proximity data were 
r-— ooiflpared with vicious models of. cognitive structure (spatial, 

hie rarcWxa^^and^ graphic) based on several triads of basic concepts, 
which defined the dimensions of semantic 'space or formed' the base of a 
learning hierarchy. For the ^teastjaiowledgeable groups , the models 
based on the density-distance-velocity^ tTia<Lfitted the empirical data 
best, whereas for the most knowledgable- groups tlfe^ mass^distance-time 
t ( riad gave a better fit. . This suggests that density (perhaps-throygh^ 
floatation) and velocity (perhaps through overtaking) have a better, 
claim to natural ostensiveness than mass and tfo£ ,, which seem to acquire 
their special roTe through the way physics is taught. * . 

Although I have dis-cussed this, and other, research on the organization 
of scientific concepts in semantic memory in more detail elsewhere 
(Preece, 1978), I hope that v the above brief account is sufficient to 
* show that word-association methods can yield interesting information. oh 
the cognitive structures of nonscience and beginning science students. 
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C / 

t 

Purpose * 

^Th±s-research was concerned witfr answering two major questions: 
1) How well do students^tetijiguish between teleological and causal 
explanations? and, 2) Can this ability"^ -taught? J* 



Rationale 



^ The author States th^at the anthropomorphic implications of' teleo- 
logical formulations have Ijeen rejected by many science educators. . He 
\is concerned that a much more basic aspect of teleology is being ^ . 
ignored by science educators—the danger o'f confusing ends and the ; 
causes by which they are brought about. As Braithwaite* (1954) stated," ' 
"In a causal explanation the explicandum is explained in terms of a 
cause which either precedes it or ifr simultaneous 1 with it; in a teleo- 
logical explanation the" explicandumals explained 'afc" being cauSally * 
related either to a particular goa^Fin the future or to a biological 
end is as much .future as present or p£st." # f * * * 

The author's basic .assumption is "that in otde/c to 'achieve 'the * 
ability to distinguish between causal and teleological explanations/ the 
student had to. learij one simple principle, namely that biological pro- 
cesses 3re not'brought about by their. ends but by specific causal^- mainly 
neural and hormonal, % mechatii3ms* 11 - Bartov continues his premise by 
stating "that , 'the quite sitaple- principle In question, whichlian fee 
exemplified by a great number of otherwise unrelated biological 'facts, 



may be readily learned,^ well retained, and r subsequently applied by 
* * most high school students /I With this in mind, an experiment was set 
, up to assess students f * ability -and to measure thfeir gain. 



/ 



* Research and Design yVocedures m 

* <r 

Six hundred tenth-grade science students were .given pretests, and 
*390 completed bo.th the pretests,and the posttest in a nonequivalent 
control group design, * These students were 'from 21 classes in fiye high 
schools; l!3 in 'trfee experimental group and 8 classes in the control group. 

All of* these classes studied biology with their normal classroom 
« ) « ^ » • 

*teacher with the experimental classe-s receiving an additional^ five . 

lessons. The control classes reefed vexl ; no special treatment and the , 

. ' • * regular biology lessons'Vere claimed t;o have no effect tm-the invest^ 

. y/ f gateid questipn. . • * m . * f < , 4 

^ — - — - ' ' < - - t - J ' 

' . TKe^reatment lessons were also conducted^ by regular classroom 

teachers who followed^tottiy^guW lessons dealt with ^ 

biological* principles and two of th^Te^sona^were devoted to disgussipn * 

of homework assigned "the end of "the Qther treatment^lessojag^ " These - 

treatment lessons* involved a particuja^ biological phenomenon about 

wfiicH* students would suggest hypotheses, draw deductions from thi 

hypotheses and -plan and perfomf experiments tb *ver4fy deductions, 

* » b • • '» ♦ 




„ The teSt instrument, Test? On^Causal And* Teleoldgical 'Re&^tlonshipo 
-^TOCATR) • provided students with ^statement jo4 a biological phefu^x^n**^^ 

and four sample statements:- one each of causal,, teleological*. anthro- 

' - * /* ^ 

• pomorphifc, and* b6th te£eologicaI and anthropomorphic .explanations of . 

* / * * v.- • • ' * * * * " 

\* the phenomenon. Scoring was accomplished by giving ojfle point -fov ; each* 
\ correct response. „ . • * , ' * * 

Pretest scores were used as a covari-at^iri analysis of covdtianrce 
witH posttest scores being critTerion variables. 1 In addition, another 
° versj^ of the TQCATR T^st^wa? used ia.g posttest oiily form'/ This 

*v < \ « V f t v .* 

A • * t- - 1 « - ^ 



version's data were analyzed using a t-test between experimental and 
control groups, \ v * «.f 



- Finding^ 0 

. B . J. ** t . * - 

Pretest scores supported the assumption that secondary school 
students have difficulty discriminating" between causes and' purposes.. 
Analysis $f covariance indicates that 'at the end of the* treatment the 
\ f % experimental group had significantly higher scores than the control c 
group* T-tesj^results of a comparison of posttest only TOGATR No, 2 
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ABSTRACTOR'S ^ANALYSIS 



Bartov Yfas attempted to investigate ^ relatively complex area, 
^s generations or .biologists, antt iJhilo^sopfrers have misunderstood 



AgLsto tie' s use of teleology, leading to violent rejection of Aristotle 
by Bacon, Descartes, and others, *moderiv^ay biology students are equally 
^* * unlikely to be able to differentiate betweek causes ~*ancl purposes. 



• / 



scores indicated*; £he 'same, significant difference in faVor.of the 
^experimental^ group*. *• %- • 



. Interpretations * \ ' ' • * • < 

- > * . w * : * x / 

The Author concludes tH^t the experimental treatment of ^five 

lessons was effectiv^ln improving the ability of secondary school 

students to distinguish between teleologjicai ^nd causal explanations/ w 

He sees this as justification for providing Special* treatment to f ^ 

students^ developing these abilities and recommends, that -lessons be* 

conducted acco.rcFing to specific suggestions in the^aper and that in 

ahy discussion, studeitts shotild b6 a &sked to^provide both* causal and 

teleological explanations. - As e final note,- Bartov suggests that. * 

questions similar to the TOCATR s^buld be included in examination- 

^papers in. biology 4 J&r a routine evaluation oJ^staident achievement,. 



Bartov's development of an instrument to assess tihis difficulty and * * 

-his design of a ^simple a'J& short experimental program to*aileviate the 

deficiency ar*2 commendable. It is sfeif-evident that teachers, should be 

• concerned witfi these differences > but, I suspect, few teacher^ deal 

v ^ I 

w£th the philosophy of science* much less worry about how students 

phrase statements of cause and purpose during explanation^. 

Since philosophers of science have had great difficulty in deal - 
ing with, teleological principles, I must take exception with Bartov's- 

statement "that "the quid* sipnple principle in questisn . . . may be 

J " ^ \ 

readily learned, wellr^tained , and subsequently applied by most high - 

t> ^ 
school students." Certainly, if this were the case, then his pretest 

scores would have been considerably higher and the study itself would 

be unnecessary f <s ' 

The study is weakened somewhat by* the nonrandomness* and inequality 
of the experimental *and 'control -groups. Adding to this 'difficulty is 
the fac£ tfie experimental groups got the same\lessons as the control 
group plus an additional five special lessons designed to specifically 
deal with suggesting hypotheses, deducing from" hypotheses, planning 
and performing experiments > and drawing conclusions. Certainly you 
would* expect the group who got everything plus something else to haye 
gained from the experience! The author states. that the regular lessors 
were irrelevant to. the ques'tions being investigated but provides no 
evidence "of - that. Even if the lessons themselves did notf'contain rele- 
vant information, no observations of teacher performance were made and,, 
thus^ we have absolutely fio notion^of what individual teachers did, in % 

the privacy of th£ir own classrooms. 

^ *> . 

The treatment, itself sounds most interesting and innovative. It 
would be very useful to the reader if the treatment were explained some- 
what better so that the reader could* know precisely .what; happened in 
the classroom. It "is unclear what went on, during the lessons whi^h were 
conducted after a sequence where apparently students suggested hxpo- 
,-theses. and worked with them. The study could hot^be replicated from 
the information given> by any* means. , * 
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^'The Test On Causal And ..Teleological Relationships instrument sounds 
most interesting* I could certainly, agree w4th,the author tliat such 
items would be appropriate for partial evaluation of student achieve- 
ment in biology. As interesting as the test instrument is, .however, 
* it is certainly hot appropriate to. call it a "stahdardized*test" as 
does the author. , ' * 

- ~- Analysis of covariance is quite reasonable *to use in this case and 
showed that the' covariate (the pretest) showed a significant difference 
betvje&n the two groups. With this in mind, it would now seem inappiro- 
. priate'to do an analysis of the posttest only scores. The author afto 
erroneously states that "only a t-tesKcould be and was used t^ compare 
the mean scores of. experimental ^md control groups." Certainly^ there 
foould seem to be a number of other appropriate statistical testis which 
could be usfed. T 

^The j statement , * "the experimental group mad& substantially more pro- 
gress than the control" cannot be legitimately made since the comparison 
that he ran with this analysis of covariance was a postte'st comparison 
and not a pretest/posttest comparison. 

/ 

The written report^could be improved gfeatly by^e^panding the 
explanation of the /treatment, more Careful wording of the paper in 
general, and by providing more specific implications about what to' do 

with the information wa have learned from this study. For instance, 

^ — J 

1 Barto.v states that "lessons on reflexes and tropisms should be conducted 
according to the suggestions outlined 'in this paper 41 'is not a very use- 
ful statement since the suggestions were not really outlined. . 

Very 'little research is done on the effect of teaching the .philo- • 
sophy of science in high schools and it would seem ; to-be a very fertile 
area for the future. It would be interesting to find put if Bartov's 
instrument detects significant differences among different principles 
within science, differences between te'aching strategies, or differences 
between various curricula when teaching is' controlled . 
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The quotation from Braithwaite (1953), defining the notions of 
teleological and causal explanations, is veVy confusing 'and must be 
dealt with 'in some detail. 

The statement "In a teleological explanation the explicandum is 
explained as being 6 causally related either to^a particular goal in the 
•future, or to a biological end which, is as much future as present or ' 
past" seems to obliterate or even to annul the differences between 
teleological ancl causal explanations. 

Braithwaite* s distinction between "goals" and "biological ends" is highly 
individualistic and o£ little or no importance in biology, at any rate—in 
high school biology. According to Braithwaite "the peculiarity of a 
biological end' is that it is a permanent goal," like the continuous 
beating of the heart responsible for the continuous circulation of the 
blood, and therefore* biological ends are J 'as ; much .future as present or 
past."^ Whereas^goals refer tc5 a particular short action, such as a 
"single beating of the heart, "responsible for'the circulation of blood a 
short time afterwards.". 

When only goals are takdn into considej aticm; as it, should bey the 
differences between teleological and cadsal explanations 'are quite 
distinct and clear.' "A teleological answer (to' the /question 'Why') 
•explains^ present event .by means of a future event, ...a nonteleoiogical 
•?nsv£er--in terms of a present or past cause." This rul'e Jiolds good- for 
"^ll^teleological explanations .which are not reducible^tcT explanations * 
in terms of a Conscious- intention to attain the goal" (Braithwaite, ; 
1953)'. i*'-". 1 . 

Moreover, even intentional activities (whi^ch ar£*limited to human beings " 
orilyvax l^ast in the opinion of most b}olog.ists) are no exception to 
*the above rule. . "Tfeleological explanations " of intentional goal-directed 
.activities are always understood as reducible to causal "explanations 
tei-th intentions as causes (Braithwaite, 1953) . I*i the case of intentional 
.activities the action is not caused by the^yet *unattained and— maybe * 
heveV^ to be -attaint- future goal*' but by the. desire to attain/ it,, which 
precedes the action. Intentional, explanations conform to the\ conditions '/ 
for qausal explanation, and should be "regarded ,3s such explanations , 'to , 
all intents and purposes, Teleological (unintentional) explanations 
refer to future goals and not to present or past causes. ■ 



The definitions of teleological and cau^Q. explanations were discussed 
at some length, because ol their crucial importance for 'the issue under 
consideration. Some other points raised in the r^piew are dealt with 
briefly in the following lines. „ • 

The reviewer questions the hypothesis ^ that "the quite simple principle 
in question (that biological processes are no£ brought about by their 
ends) may be readily learned* well retained and subsequently applied by 
most high school students." 

This question may be answered only by experiment, such as that described 
in the reviewed article. \^/ 

I certainly admit that "the study could not be replicafted from the 
information given (in the article), by any means*" The reviewer ! «s 
suggestions for further research, such as "to find' out if Bartov's 
instrument detects significant differences among different principles 
within science, differences between teaching strategies," etc., were 
also made by* me ill my doctoral ^dissertation (written in Hebrew). I 
specifically referred to the so myjch debated question of the relative 
efficacy of the discussion, demonstration, and laboratory methods in 
teaching biology. The treatment lessons developed for my study can be 
given by -any of these methods. They have also the ad^ntage of economy 
of time, as only five lessons are needed to accomplish the* treatment . I 
would be very happy to have- the possibility to collaborate in improving 
and replicating my study under discussion in more controlled conditions 
than were possible here" in Israel, as well as in planning and carrying 
out new investigations, base.d on the tests and treatment lessons 
developed for the study described in the reviewed article. 

I 
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